-- Logs begin at Tue 2022-06-14 16:56:27 UTC, end at Tue 2022-06-14 18:49:19 UTC. -- Jun 14 18:18:03.920919 dv-cinder-844563-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 14 18:18:03.932394 dv-cinder-844563-2-iscsi devstack@n-api.service[104032]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 14 18:18:03.934086 dv-cinder-844563-2-iscsi devstack@n-api.service[104032]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 14 18:18:03 2022] *** Jun 14 18:18:03.934086 dv-cinder-844563-2-iscsi devstack@n-api.service[104032]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 14 18:18:03.934086 dv-cinder-844563-2-iscsi devstack@n-api.service[104032]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 14 18:18:03.934086 dv-cinder-844563-2-iscsi devstack@n-api.service[104032]: nodename: dv-cinder-844563-2-iscsi Jun 14 18:18:03.934086 dv-cinder-844563-2-iscsi devstack@n-api.service[104032]: machine: x86_64 Jun 14 18:18:03.934086 dv-cinder-844563-2-iscsi devstack@n-api.service[104032]: clock source: unix Jun 14 18:18:03.934086 dv-cinder-844563-2-iscsi devstack@n-api.service[104032]: pcre jit disabled Jun 14 18:18:03.934086 dv-cinder-844563-2-iscsi devstack@n-api.service[104032]: detected number of CPU cores: 4 Jun 14 18:18:03.934086 dv-cinder-844563-2-iscsi devstack@n-api.service[104032]: current working directory: / Jun 14 18:18:03.934086 dv-cinder-844563-2-iscsi devstack@n-api.service[104032]: detected binary path: /usr/bin/uwsgi-core Jun 14 18:18:03.935174 dv-cinder-844563-2-iscsi devstack@n-api.service[104032]: your processes number limit is 47680 Jun 14 18:18:03.935174 dv-cinder-844563-2-iscsi devstack@n-api.service[104032]: your memory page size is 4096 bytes Jun 14 18:18:03.935174 dv-cinder-844563-2-iscsi devstack@n-api.service[104032]: detected max file descriptor number: 2048 Jun 14 18:18:03.935174 dv-cinder-844563-2-iscsi devstack@n-api.service[104032]: lock engine: pthread robust mutexes Jun 14 18:18:03.935174 dv-cinder-844563-2-iscsi devstack@n-api.service[104032]: thunder lock: enabled Jun 14 18:18:03.935174 dv-cinder-844563-2-iscsi devstack@n-api.service[104032]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 14 18:18:03.935174 dv-cinder-844563-2-iscsi devstack@n-api.service[104032]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 14 18:18:03.979217 dv-cinder-844563-2-iscsi devstack@n-api.service[104032]: Python main interpreter initialized at 0x55adb05b59c0 Jun 14 18:18:03.979217 dv-cinder-844563-2-iscsi devstack@n-api.service[104032]: python threads support enabled Jun 14 18:18:03.979217 dv-cinder-844563-2-iscsi devstack@n-api.service[104032]: your server socket listen backlog is limited to 100 connections Jun 14 18:18:03.979217 dv-cinder-844563-2-iscsi devstack@n-api.service[104032]: your mercy for graceful operations on workers is 90 seconds Jun 14 18:18:03.979623 dv-cinder-844563-2-iscsi devstack@n-api.service[104032]: mapped 403077 bytes (393 KB) for 2 cores Jun 14 18:18:03.979697 dv-cinder-844563-2-iscsi devstack@n-api.service[104032]: *** Operational MODE: preforking *** Jun 14 18:18:03.979927 dv-cinder-844563-2-iscsi devstack@n-api.service[104032]: *** uWSGI is running in multiple interpreter mode *** Jun 14 18:18:03.979927 dv-cinder-844563-2-iscsi devstack@n-api.service[104032]: spawned uWSGI master process (pid: 104032) Jun 14 18:18:03.980137 dv-cinder-844563-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 14 18:18:03.981243 dv-cinder-844563-2-iscsi devstack@n-api.service[104032]: spawned uWSGI worker 1 (pid: 104033, cores: 1) Jun 14 18:18:03.981243 dv-cinder-844563-2-iscsi devstack@n-api.service[104032]: spawned uWSGI worker 2 (pid: 104034, cores: 1) Jun 14 18:18:03.981243 dv-cinder-844563-2-iscsi devstack@n-api.service[104032]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 14 18:18:04.654107 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 14 18:18:04.662434 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 14 18:18:05.836585 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 14 18:18:05.836585 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: from cryptography.utils import int_from_bytes Jun 14 18:18:05.837219 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 14 18:18:05.837219 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: from cryptography.utils import int_from_bytes Jun 14 18:18:05.842697 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 14 18:18:05.842697 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: from cryptography.utils import int_from_bytes Jun 14 18:18:05.843200 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 14 18:18:05.843200 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: from cryptography.utils import int_from_bytes Jun 14 18:18:08.435023 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 14 18:18:08.435622 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 14 18:18:08.435798 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 14 18:18:08.436158 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 14 18:18:08.436304 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 14 18:18:08.436700 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 14 18:18:08.436788 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 14 18:18:08.436869 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.436964 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 14 18:18:08.437099 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.437278 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 14 18:18:08.437442 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.437582 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 14 18:18:08.437749 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.437926 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.438079 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.438240 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.438382 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.438553 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.438704 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.438871 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.439027 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.439199 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.439358 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.439513 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.439611 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.439812 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.439917 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.440126 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.440221 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-2-iscsi {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.440994 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.441207 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.441363 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.441538 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.441644 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.441855 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.441961 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-2-iscsi {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.442179 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.442294 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.442489 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.442599 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.442793 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.442887 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.443102 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.443204 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.443401 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.443600 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.443749 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.444011 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.444166 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.444334 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.444510 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.444675 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.444820 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.444957 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.445105 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.445265 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.445395 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.445601 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.445746 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.445924 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.446050 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.446232 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.446355 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.446559 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.446671 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.446869 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.446964 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.447277 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-2-iscsi {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.447422 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.447594 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.447906 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.448136 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.448333 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.448549 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-2-iscsi {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.448709 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.448842 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.448926 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.449058 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.449236 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.449327 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.449535 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.449763 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.449865 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.450075 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.450169 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.450385 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.450470 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.450760 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.450854 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.451078 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.451166 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.451398 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.451494 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.451694 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.451792 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.452001 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.452095 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.452309 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.452394 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.452633 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.452742 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.452935 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.453030 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.453237 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.453324 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.453501 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.453591 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.453809 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.453909 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.454125 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.454262 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.454440 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.454527 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.454720 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.454805 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.455001 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.455153 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.455297 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.455444 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.455565 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.455665 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.455855 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.456544 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.456642 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.456722 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.456799 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.456876 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.456963 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.457043 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.457138 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.457230 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.457480 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.457612 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.457774 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.457922 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.458075 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.458170 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.458379 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.458467 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.458690 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.458840 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.459003 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.459089 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.459288 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.459387 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.459600 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.459710 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.459908 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.460003 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.460219 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.460316 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.460539 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.460625 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.460842 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.460926 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.461156 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.461253 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.461511 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.461617 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.461818 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.461910 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.462124 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.462224 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.462446 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.462531 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.462755 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.462861 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.463057 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.463157 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.463365 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.463482 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.463679 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.463766 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.463990 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.464085 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.464296 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.464382 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.464542 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.464628 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.464839 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.464925 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.465143 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.465227 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.465514 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.465604 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.465771 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.465865 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.466071 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.466156 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.466376 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.466516 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.466672 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.466807 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.466978 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.467120 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.467282 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.467427 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.467589 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.467733 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.467892 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.468029 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.468195 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.468298 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.468496 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.468588 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.468801 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.468931 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.469102 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.469239 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.469402 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.469530 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.469757 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.469870 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.470071 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.470175 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.470372 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.470464 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.470679 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.470796 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.470977 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.471085 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.471282 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.471377 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.471619 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.471714 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.472049 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.472159 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.472241 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.472320 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.472517 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.472604 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.472843 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.472967 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.473142 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.473255 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.473526 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.473633 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.473805 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.473975 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.474112 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.474200 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.474414 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.474506 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.474731 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.474828 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.475045 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.475150 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.475346 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.475500 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.475663 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.475757 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.475962 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.476055 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.476263 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.476356 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.476567 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.476653 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.476870 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.476956 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.477171 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.477256 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.477490 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.477583 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.477793 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.477880 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.478089 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.478174 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.478399 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.478482 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.478673 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.478766 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.478974 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.479107 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.479277 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.479398 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.479596 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.479692 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.479911 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.480016 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.480213 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.480298 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.480519 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.480605 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.480820 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.480915 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.481139 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:18:08.481257 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.481502 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.481604 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.481839 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.481934 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.482183 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.482269 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.482497 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.482583 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.482813 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.482900 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.483138 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.483231 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.483448 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.483535 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.483756 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.483843 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.484066 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.484157 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.484381 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.484465 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.484688 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.484774 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.484997 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.485082 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.485304 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.485421 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.485642 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.485731 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.485959 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.486046 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.486268 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.486354 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.486584 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.486671 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.486898 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.486989 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.487747 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.487848 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.488057 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.488307 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.488394 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.488689 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.488819 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.489009 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.489180 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.489311 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.489520 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.489669 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.489848 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.490013 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.490175 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.490381 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.490473 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.490636 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.490785 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.490953 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.491096 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.491260 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.491419 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.491566 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.491752 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.491872 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.492065 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.492188 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.492382 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.492528 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.492691 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.492840 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.493007 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.493155 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.493314 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.493480 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.493648 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.493795 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.493955 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.494105 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.494293 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.494414 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.494627 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.494722 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.495028 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.495116 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.495343 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.495436 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.495655 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.495741 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.495965 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.496050 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.496273 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.496367 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.496582 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.496666 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.496883 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.496967 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.497187 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.497355 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.497517 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.497619 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.497822 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.497908 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.498124 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.498221 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.498432 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.498517 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.498732 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.498817 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.499052 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.499145 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.499380 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.499513 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.499685 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.499775 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.499993 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.500087 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.500307 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.500397 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.500615 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.500702 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.500920 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.501007 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.501227 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.501322 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.501557 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.501648 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.501860 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.501947 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.502166 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.502251 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.502470 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.502556 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.503661 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.503920 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.503920 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.504070 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.504566 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.504674 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.504766 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.504848 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.504959 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.505150 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.505267 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.505519 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.505609 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.505916 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.506002 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.506234 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.506328 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.506548 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.506640 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.506858 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.506954 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.507185 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.507272 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.507501 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.507588 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.507815 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.507903 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.508151 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.508246 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.508485 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.508571 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.508791 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.508877 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.509115 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.509219 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.509505 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.509638 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.509784 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.509874 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.510087 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.510187 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.510396 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.510490 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.510700 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.510798 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.511003 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.511099 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.511306 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.511393 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.511612 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.511698 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.511915 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.512012 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.512218 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.512311 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.512519 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.512643 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.512823 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.512911 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.513125 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.513211 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.513464 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.513565 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.513772 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.513860 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.514080 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.514165 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.514381 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.514466 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.514683 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.514777 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.515028 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.515115 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.515333 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.515433 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.515675 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.515768 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.516009 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.516096 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.516331 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.516425 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.516651 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.516736 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.516962 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.517047 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.517278 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.517372 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.517610 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.517708 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.517923 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.518009 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.518236 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.518331 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.518546 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.518633 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.518868 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.519027 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.519280 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.519425 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.519600 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.519859 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.519974 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.520176 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.520277 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.520504 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.520590 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.520820 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.520913 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.521145 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.521239 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.521517 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.521609 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.521792 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.521878 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.522135 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.522236 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.522466 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.522559 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.522785 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.522876 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.523104 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.523198 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.523415 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.523508 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.523730 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.523816 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.524044 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.524130 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.524355 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.524449 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.524667 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.524753 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.524978 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.525065 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.525300 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.525392 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.525672 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.525772 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.525998 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.526085 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.526308 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.526395 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.526631 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.526716 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.526939 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.527024 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.527255 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.527340 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.527557 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.527638 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.527870 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.527959 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.528197 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.528291 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.528517 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.528615 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.528825 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.528918 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.529136 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.529224 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.529489 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.529591 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.529779 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.529906 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.530089 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.530176 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.530394 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.530488 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.530699 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.530786 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.531003 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.531098 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.531310 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.531404 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.531618 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.531710 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.531922 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.532016 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.532228 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.532334 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.532531 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.532625 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.532836 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.532930 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.533139 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.533225 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.533440 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.533551 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.533764 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.533896 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.534099 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.534191 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.534424 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.534671 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.534752 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.534830 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.535039 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.535204 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.535357 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.535526 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.535659 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.535857 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.535959 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.536173 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.536261 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.536485 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.536572 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.536794 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.536881 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.537103 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.537190 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.537419 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.537578 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.537784 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.537872 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.538089 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.538188 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.538391 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.538477 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.538726 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.538843 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.539041 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.539169 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.539364 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.539479 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.539677 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.539794 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.539992 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.540202 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.540321 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.540415 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.540637 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.540726 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.540951 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.541037 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.541269 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.541364 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.541606 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.541708 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.541925 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.542019 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.542233 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.542334 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.542544 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.542630 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.542858 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.542943 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.543163 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.543250 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.543470 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.543563 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.543780 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.543865 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.544087 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.544174 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.544396 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.544489 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.544711 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.544989 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.545282 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.545359 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.545638 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.545727 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.545953 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.546038 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.546269 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.546357 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.546588 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.546682 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.546906 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.547000 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.547240 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.547377 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.547560 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.547648 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.547884 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.547978 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.548187 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.548281 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.548492 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.548592 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.548795 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.548881 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.549097 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.549189 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.549402 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.549540 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.550248 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.550391 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.550557 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.550656 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.550860 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.551024 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.551166 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.551448 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.551826 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.552008 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.552095 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.552307 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.552393 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.552608 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.552693 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.552920 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.553017 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.553221 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.553310 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.553554 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.553645 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.553858 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.553947 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.554178 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.554264 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.554487 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.554573 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.554786 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.554880 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.555086 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.555179 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.555385 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.555480 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.555725 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.555812 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.556025 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.556119 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.556364 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.556473 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.556685 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.556772 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.557025 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.557112 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.557327 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.557422 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.557654 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.557741 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.557976 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.558062 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.558277 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.558365 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.558578 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.558664 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.558875 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.558961 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.559179 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.559267 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.559483 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.559569 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.559780 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.559865 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.560090 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.560185 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.560395 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.560521 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.560698 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.560786 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.561000 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.561088 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.561298 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.561385 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.561629 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.561722 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.561928 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.562004 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.562237 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.562320 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.562543 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.562844 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.563140 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.563444 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.563743 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.563832 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.564041 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.564138 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.564352 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.564446 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.564651 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.564745 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.564964 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.565060 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.565291 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.565429 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.565657 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.566369 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.566471 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.566689 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.566782 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.567016 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.567112 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.567314 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.567407 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.567627 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.567754 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.567938 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.568071 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.568257 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.568375 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.568577 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.568728 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.568874 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.569019 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.569203 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.569375 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.569639 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.569787 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.569956 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.570102 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.570269 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.570416 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.570565 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.570767 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.570964 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.571126 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.571290 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.571411 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.571499 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.571578 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.571695 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.571852 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.572009 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.572164 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.572326 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.572471 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.572616 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.572830 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.572994 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.573140 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.573346 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.573519 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.573669 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.573846 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.573994 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.574154 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.574288 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.574376 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.574464 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.574623 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.574770 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.574915 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.575070 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.575217 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.575364 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.575526 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.575689 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.575839 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.575984 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.576129 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.576285 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.576444 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.576600 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.576746 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.576894 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.577042 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.577214 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.577315 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.577395 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.577543 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.577693 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.577820 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.577969 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.578103 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.578232 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.578358 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.578502 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.578648 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.578814 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.578961 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.579118 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.579268 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.579415 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.579562 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.579723 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.579876 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.580026 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.580145 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.580226 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.580375 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.580515 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.580699 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.580847 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.581125 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.581283 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.581598 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.581772 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.581918 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.582061 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.582207 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.582356 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.582619 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.582769 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.582979 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.583123 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.583213 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.583291 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.583426 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.583643 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.583791 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.583935 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.584081 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.584236 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.584382 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.584529 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.584679 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.584829 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.584974 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.585124 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.585268 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.585412 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.585603 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.585751 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.585896 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.586053 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.586215 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.586363 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.586517 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.586664 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.586810 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.586970 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.587118 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.587265 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.587424 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.587560 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.587647 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.587743 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.587853 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.588010 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.588159 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.588300 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.588516 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.588667 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.588820 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.588962 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.589106 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.589247 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.589411 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.589646 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.589807 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.589957 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.590100 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.590241 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.590396 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.590550 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.590693 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.590839 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.590984 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.591200 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.591360 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.591505 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.591664 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.591817 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.591963 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.592120 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.592269 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.592415 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.592561 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.592704 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.592849 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.593069 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.593239 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.593386 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.593552 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.593777 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.593926 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.594087 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.594229 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.594374 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.594522 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.594680 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.594827 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.594991 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.595136 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.595281 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.595427 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.595574 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.595730 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.595881 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.596027 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.596181 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.596328 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.596473 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.596653 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.596940 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.597162 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.597668 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.597934 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.598079 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.598238 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.598398 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.598545 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.598691 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.598838 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.598984 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.599152 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.599299 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.599450 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.599586 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.599729 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.599888 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.600036 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.600216 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.600390 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.600540 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.600687 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.600834 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.600979 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.601139 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.601285 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.601429 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.601592 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.601734 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.601874 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.602034 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.602179 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.602322 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.602478 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.602626 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.602785 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.602945 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.603148 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.603300 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.603460 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.603669 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.603820 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.603981 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.604129 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.604286 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.604446 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.604554 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.604646 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.604736 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.604824 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.604968 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.605121 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.605267 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.605420 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.605631 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.605774 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.605774 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.606034 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.606180 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.606339 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.606484 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.606629 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.606773 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.606918 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.607076 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.607234 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.607382 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.607529 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.607675 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.607820 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.607980 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.608129 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.608275 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.608426 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.608573 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.608724 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.608849 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.608934 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.609043 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.609172 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.609259 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.609344 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.609440 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.609631 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.609741 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.609823 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.609949 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.610039 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.610248 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.610347 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.610547 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.610635 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.610969 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.611083 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.611173 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.611298 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.611496 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.611587 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.611908 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.612018 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.612118 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.612731 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.612930 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.613030 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.613236 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.613331 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.613609 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.613702 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.613920 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.614007 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.614245 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.614342 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.614580 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.614667 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.614914 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.615010 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.615221 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.615318 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.615529 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.615619 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.615834 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.615921 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.616136 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.616232 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.616438 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.616524 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.616745 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.616839 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.617045 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.617133 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.617345 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.617431 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.617673 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.617776 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.617997 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.618093 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.618301 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.618388 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.618607 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.618703 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.618913 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.618998 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.619214 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.619299 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.619514 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.619599 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.619815 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.619977 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.620140 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.620231 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.620444 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.620538 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.620764 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.620849 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.621075 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.621162 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.621382 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.621556 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.621711 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.621799 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.622016 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.622092 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.622355 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.622449 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.622661 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.622736 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.622975 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.623051 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.623289 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.623377 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.623602 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.623696 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.623932 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.624068 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.624242 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.624331 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.624568 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.624645 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.624874 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.624959 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.625190 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.625279 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.625527 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.625618 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.625844 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.625938 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.626160 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.626415 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.626502 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.626747 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.626834 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.627063 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.627150 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.627376 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.627462 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.627688 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.627831 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.628549 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.628716 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.629094 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.629246 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.629512 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.629607 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.629744 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.629878 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.630057 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.630147 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.630368 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.630476 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.630683 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.630769 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.630999 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.631086 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.631312 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.631422 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.631626 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.631721 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.631937 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.632042 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.632249 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.632345 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.632559 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.632654 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.632871 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.632968 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.633204 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.633291 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.633556 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.633646 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.633866 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.634042 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.634172 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.634262 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.634483 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.634570 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.634791 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.634887 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.635101 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.635188 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.635413 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.635495 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.635725 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.635821 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.636037 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.636170 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.636347 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.636435 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.636656 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.636745 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.636969 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.637064 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.637279 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.637372 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.637615 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.637704 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.637933 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.638020 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.638246 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.638333 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.638555 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.638651 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.638886 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.639014 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.639180 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.639278 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.639507 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.639717 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.639842 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.640033 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.640165 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.640365 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.640480 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.640687 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.640795 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.641008 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.641095 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.641322 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.641654 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.641746 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.641975 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.642063 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.642280 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.642375 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.642584 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.642670 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.642895 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.642990 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.643203 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.643290 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.643747 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.644176 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.644249 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.644324 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.644463 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.644553 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.644633 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.644711 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.644830 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.644925 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.645143 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.645231 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.645503 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.645701 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.645788 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.646052 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.646149 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.646366 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.646453 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.646692 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.646780 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.647000 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.647087 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.647317 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.647538 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.647632 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.647890 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.647985 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.648209 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.648296 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.648514 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.648599 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.648830 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.648925 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.649140 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.649227 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.649463 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.649554 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.649770 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.649858 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.650081 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.650177 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.650388 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.650474 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.650688 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.650793 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.651007 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.651094 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.651318 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.651406 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.651627 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.651717 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.651943 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.652029 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.652255 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.652342 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.652565 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.652652 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.652877 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.652966 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.653183 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.653278 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.653510 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.653613 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.653818 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.653905 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.654121 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.654216 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.654429 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.654571 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.654730 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.654817 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.655036 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.655132 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.655340 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.655427 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.655646 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.655732 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.655945 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.656040 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.656251 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.656339 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.656556 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.656642 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.656867 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.656963 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.657174 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.657262 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.657578 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.657666 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.657890 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.657978 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.658197 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.658282 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.658548 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.658643 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.658877 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.658965 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.659276 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.659372 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.659625 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.659720 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.659942 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.660119 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.660454 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.660539 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.660784 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.660871 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.661100 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.661188 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.661418 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.661633 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.661776 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.661871 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.662081 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.662168 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.662385 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.662636 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.662723 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.662978 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.663066 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.663292 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.663377 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.663600 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.663688 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.663909 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.663998 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.664222 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.664308 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.664529 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.664675 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.664835 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.664924 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.665140 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.665227 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.665466 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.665574 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.665778 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.665879 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.666086 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.666215 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.666387 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.666486 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.666692 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.666780 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.666998 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.667093 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.667307 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.667395 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.667619 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.667716 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.667931 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.668018 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.668240 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.668329 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.668549 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.668664 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.668857 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.668992 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.669168 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.669302 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.669514 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.669636 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.669860 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.669958 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.670183 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.670276 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.670504 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.670598 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.670819 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.670914 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.671139 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.671226 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.671442 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.671534 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.671754 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.671867 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.672063 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.672206 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.672372 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.672461 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.672696 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.672827 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.673022 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.673112 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.673338 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.673427 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.673671 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.673761 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.674008 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.674095 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.674331 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.674417 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.675150 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.675249 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.675490 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.675714 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.675932 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.676025 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.676144 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.676346 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.676467 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.676937 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.677038 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.677256 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.677351 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.677604 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.677708 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.677922 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.678009 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.678247 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.678334 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.678554 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.678641 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.678855 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.678942 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.679153 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.679242 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.679460 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.679556 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.679762 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.679859 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.680062 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.680149 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.680362 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.680507 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.680662 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.680761 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.680965 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.681052 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.681262 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.681348 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.681586 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.681760 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.681889 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.681977 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.682191 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.682285 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.682490 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.682587 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.682791 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.682878 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.683095 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.683181 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.683460 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.683553 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.683693 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.683789 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.683991 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.684078 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.684294 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.684424 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.684590 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.684677 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.684894 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.684981 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.685249 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.685391 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.685549 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.685640 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.685857 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.685948 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.686163 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.686249 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.686465 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.686552 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.686769 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.686865 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.687075 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.687162 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.687390 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.687486 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.687702 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.687801 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.688006 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.688101 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.688335 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.688421 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.688644 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.688744 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.688956 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.689050 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.689265 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.689351 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.689603 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.689741 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.689912 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.690011 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.690221 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.690946 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.691090 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.691179 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.691418 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.691667 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.691755 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.691843 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.692034 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.692122 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.692349 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.692435 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.692660 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.692755 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.692972 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.693060 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.693285 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.693372 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.693641 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.693742 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.693956 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.694052 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.694267 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.694361 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.694583 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.694677 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.694900 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.694987 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.695212 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.695298 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.695531 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.695629 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.695844 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.695930 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.696169 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.696255 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.696483 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.696569 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.696793 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.696879 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.697111 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.697197 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.697427 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.697585 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.697762 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.697864 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.698083 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.698170 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.698401 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.698489 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.698730 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.698818 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.699049 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.699134 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.699360 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.699447 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.699661 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.699747 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.699905 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 14 18:18:08.700002 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.700338 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.700658 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.701009 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.701341 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.701683 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.702001 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.702308 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:18:08.702555 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 14 18:18:08.763786 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO dbcounter [None req-5378a773-8abd-4253-89c6-5aab8244c2d8 None None] Registered counter for database nova_api Jun 14 18:18:08.765019 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO dbcounter [None req-8a25da1d-d523-499c-b0fc-95e179d40d54 None None] Registered counter for database nova_api Jun 14 18:18:08.785177 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG oslo_db.sqlalchemy.engines [None req-5378a773-8abd-4253-89c6-5aab8244c2d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104033) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 18:18:08.789126 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG oslo_db.sqlalchemy.engines [None req-8a25da1d-d523-499c-b0fc-95e179d40d54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104034) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 18:18:08.792428 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG dbcounter [-] [104033] Writer thread running {{(pid=104033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 18:18:08.795783 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG dbcounter [-] [104034] Writer thread running {{(pid=104034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 18:18:08.851397 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.context [None req-5378a773-8abd-4253-89c6-5aab8244c2d8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fc5dd7f6-292c-4a57-9b07-38a1b91b5959(cell1) {{(pid=104033) load_cells /opt/stack/nova/nova/context.py:464}} Jun 14 18:18:08.854292 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.context [None req-8a25da1d-d523-499c-b0fc-95e179d40d54 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fc5dd7f6-292c-4a57-9b07-38a1b91b5959(cell1) {{(pid=104034) load_cells /opt/stack/nova/nova/context.py:464}} Jun 14 18:18:08.855525 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG oslo_concurrency.lockutils [None req-5378a773-8abd-4253-89c6-5aab8244c2d8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:18:08.857110 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG oslo_concurrency.lockutils [None req-5378a773-8abd-4253-89c6-5aab8244c2d8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:18:08.857938 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG oslo_concurrency.lockutils [None req-5378a773-8abd-4253-89c6-5aab8244c2d8 None None] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:18:08.858401 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG oslo_concurrency.lockutils [None req-8a25da1d-d523-499c-b0fc-95e179d40d54 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:18:08.859892 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG oslo_concurrency.lockutils [None req-5378a773-8abd-4253-89c6-5aab8244c2d8 None None] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:18:08.860013 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG oslo_concurrency.lockutils [None req-8a25da1d-d523-499c-b0fc-95e179d40d54 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:18:08.860751 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG oslo_concurrency.lockutils [None req-8a25da1d-d523-499c-b0fc-95e179d40d54 None None] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:18:08.861871 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO dbcounter [None req-5378a773-8abd-4253-89c6-5aab8244c2d8 None None] Registered counter for database nova_cell0 Jun 14 18:18:08.863508 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG oslo_concurrency.lockutils [None req-8a25da1d-d523-499c-b0fc-95e179d40d54 None None] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:18:08.865562 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO dbcounter [None req-8a25da1d-d523-499c-b0fc-95e179d40d54 None None] Registered counter for database nova_cell0 Jun 14 18:18:08.866261 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO dbcounter [None req-5378a773-8abd-4253-89c6-5aab8244c2d8 None None] Registered counter for database nova_cell1 Jun 14 18:18:08.869440 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO dbcounter [None req-8a25da1d-d523-499c-b0fc-95e179d40d54 None None] Registered counter for database nova_cell1 Jun 14 18:18:08.873620 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG oslo_db.sqlalchemy.engines [None req-5378a773-8abd-4253-89c6-5aab8244c2d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104033) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 18:18:08.874930 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG oslo_db.sqlalchemy.engines [None req-5378a773-8abd-4253-89c6-5aab8244c2d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104033) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 18:18:08.879067 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG oslo_db.sqlalchemy.engines [None req-8a25da1d-d523-499c-b0fc-95e179d40d54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104034) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 18:18:08.879860 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG oslo_db.sqlalchemy.engines [None req-8a25da1d-d523-499c-b0fc-95e179d40d54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104034) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 18:18:08.882580 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG dbcounter [-] [104033] Writer thread running {{(pid=104033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 18:18:08.883859 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG dbcounter [-] [104033] Writer thread running {{(pid=104033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 18:18:08.886758 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG dbcounter [-] [104034] Writer thread running {{(pid=104034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 18:18:08.888051 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG dbcounter [-] [104034] Writer thread running {{(pid=104034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 18:18:09.031167 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO dbcounter [None req-5378a773-8abd-4253-89c6-5aab8244c2d8 None None] Registered counter for database nova_cell0 Jun 14 18:18:09.036914 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO dbcounter [None req-8a25da1d-d523-499c-b0fc-95e179d40d54 None None] Registered counter for database nova_cell0 Jun 14 18:18:09.039892 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG oslo_db.sqlalchemy.engines [None req-5378a773-8abd-4253-89c6-5aab8244c2d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104033) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 18:18:09.044751 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG oslo_db.sqlalchemy.engines [None req-8a25da1d-d523-499c-b0fc-95e179d40d54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104034) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 18:18:09.044924 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG dbcounter [-] [104033] Writer thread running {{(pid=104033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 18:18:09.049377 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG dbcounter [-] [104034] Writer thread running {{(pid=104034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 18:18:09.497287 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: WARNING keystonemiddleware.auth_token [None req-5378a773-8abd-4253-89c6-5aab8244c2d8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 14 18:18:09.504882 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: WARNING keystonemiddleware.auth_token [None req-5378a773-8abd-4253-89c6-5aab8244c2d8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 14 18:18:09.512322 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: WARNING keystonemiddleware.auth_token [None req-8a25da1d-d523-499c-b0fc-95e179d40d54 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 14 18:18:09.520055 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: WARNING keystonemiddleware.auth_token [None req-8a25da1d-d523-499c-b0fc-95e179d40d54 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 14 18:18:09.864338 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: WARNING keystonemiddleware.auth_token [None req-5378a773-8abd-4253-89c6-5aab8244c2d8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 14 18:18:09.866245 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: WARNING keystonemiddleware.auth_token [None req-8a25da1d-d523-499c-b0fc-95e179d40d54 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 14 18:18:09.870405 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: WARNING keystonemiddleware.auth_token [None req-5378a773-8abd-4253-89c6-5aab8244c2d8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 14 18:18:09.872175 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: WARNING keystonemiddleware.auth_token [None req-8a25da1d-d523-499c-b0fc-95e179d40d54 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 14 18:18:09.875731 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55adb05b59c0 pid: 104033 (default app) Jun 14 18:18:09.877487 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55adb05b59c0 pid: 104034 (default app) Jun 14 18:18:09.878471 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-5378a773-8abd-4253-89c6-5aab8244c2d8 None None] Calling method '>' {{(pid=104033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:18:09.880081 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO nova.api.openstack.requestlog [None req-5378a773-8abd-4253-89c6-5aab8244c2d8 None None] 10.222.0.78 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002774 Jun 14 18:18:09.880485 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: [pid: 104033|app: 0|req: 1/1] 10.222.0.78 () {50 vars in 788 bytes} [Tue Jun 14 18:18:09 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:19:32.269957 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-8a25da1d-d523-499c-b0fc-95e179d40d54 None None] Calling method '>' {{(pid=104034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:19:32.271976 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO nova.api.openstack.requestlog [None req-8a25da1d-d523-499c-b0fc-95e179d40d54 None None] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002801 Jun 14 18:19:32.272369 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: [pid: 104034|app: 0|req: 1/2] 10.222.0.78 () {54 vars in 930 bytes} [Tue Jun 14 18:19:32 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:19:32.285137 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG dbcounter [-] [104033] Writing DB stats nova_api:SELECT=3 {{(pid=104033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:19:32.286359 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG dbcounter [-] [104033] Writing DB stats nova_cell1:SELECT=3 {{(pid=104033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:19:32.287283 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG dbcounter [-] [104033] Writing DB stats nova_cell0:SELECT=3 {{(pid=104033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:19:32.288412 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG dbcounter [-] [104033] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:19:32.804159 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-f2355632-ed50-47f7-9545-9cb937233b7d admin admin] Calling method '>' {{(pid=104033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:19:32.840040 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO nova.api.openstack.requestlog [None req-f2355632-ed50-47f7-9545-9cb937233b7d admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.560622 Jun 14 18:19:32.841138 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: [pid: 104033|app: 0|req: 2/3] 10.222.0.78 () {60 vars in 1291 bytes} [Tue Jun 14 18:19:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:19:35.092277 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-8a25da1d-d523-499c-b0fc-95e179d40d54 None None] Calling method '>' {{(pid=104034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:19:35.093330 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO nova.api.openstack.requestlog [None req-8a25da1d-d523-499c-b0fc-95e179d40d54 None None] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jun 14 18:19:35.093935 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: [pid: 104034|app: 0|req: 2/4] 10.222.0.78 () {54 vars in 930 bytes} [Tue Jun 14 18:19:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:19:35.160786 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-ca589019-e289-4ea7-97e4-49c3e5f1eb97 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "c1", "os-flavor-access:is_public": true, "name": "cirros256", "ram": 256, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1}} {{(pid=104033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:19:35.181872 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 14 18:19:35.181872 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: warnings.warn(msg) Jun 14 18:19:35.260521 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO nova.api.openstack.requestlog [None req-ca589019-e289-4ea7-97e4-49c3e5f1eb97 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.160028 Jun 14 18:19:35.261273 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: [pid: 104033|app: 0|req: 3/5] 10.222.0.78 () {64 vars in 1282 bytes} [Tue Jun 14 18:19:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 18:19:35.275395 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG dbcounter [-] [104034] Writing DB stats nova_api:SELECT=3 {{(pid=104034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:19:35.276200 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG dbcounter [-] [104034] Writing DB stats nova_cell1:SELECT=3 {{(pid=104034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:19:35.277158 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG dbcounter [-] [104034] Writing DB stats nova_cell0:SELECT=3 {{(pid=104034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:19:35.278180 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG dbcounter [-] [104034] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:19:35.485826 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-cb07e77a-f288-4264-8ac3-bd1ba896b085 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:19:35.488412 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 14 18:19:35.488412 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: warnings.warn(msg) Jun 14 18:19:35.623489 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO nova.api.openstack.requestlog [None req-cb07e77a-f288-4264-8ac3-bd1ba896b085 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.353242 Jun 14 18:19:35.629945 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: [pid: 104034|app: 0|req: 3/6] 10.222.0.78 () {64 vars in 1335 bytes} [Tue Jun 14 18:19:35 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:19:37.886318 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-ca589019-e289-4ea7-97e4-49c3e5f1eb97 admin admin] Calling method '>' {{(pid=104033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:19:37.886318 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO nova.api.openstack.requestlog [None req-ca589019-e289-4ea7-97e4-49c3e5f1eb97 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jun 14 18:19:37.886318 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: [pid: 104033|app: 0|req: 4/7] 10.222.0.78 () {54 vars in 930 bytes} [Tue Jun 14 18:19:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:19:38.009419 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-a3180063-cce0-49aa-abfc-5fef63790a7c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "ram": 512, "os-flavor-access:is_public": true, "swap": 0, "id": "d1", "name": "ds512M", "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=104034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:19:38.032329 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 14 18:19:38.032329 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: warnings.warn(msg) Jun 14 18:19:38.119068 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO nova.api.openstack.requestlog [None req-a3180063-cce0-49aa-abfc-5fef63790a7c admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.226849 Jun 14 18:19:38.119559 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: [pid: 104034|app: 0|req: 4/8] 10.222.0.78 () {64 vars in 1282 bytes} [Tue Jun 14 18:19:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 14 18:19:38.131436 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-c61c11b0-873e-412e-8d41-a36f4edf3454 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:19:38.132935 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 14 18:19:38.132935 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: warnings.warn(msg) Jun 14 18:19:38.256088 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO nova.api.openstack.requestlog [None req-c61c11b0-873e-412e-8d41-a36f4edf3454 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.128258 Jun 14 18:19:38.256793 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: [pid: 104033|app: 0|req: 5/9] 10.222.0.78 () {64 vars in 1335 bytes} [Tue Jun 14 18:19:38 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:19:40.540142 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-a3180063-cce0-49aa-abfc-5fef63790a7c admin admin] Calling method '>' {{(pid=104034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:19:40.541191 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO nova.api.openstack.requestlog [None req-a3180063-cce0-49aa-abfc-5fef63790a7c admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jun 14 18:19:40.542062 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: [pid: 104034|app: 0|req: 5/10] 10.222.0.78 () {54 vars in 930 bytes} [Tue Jun 14 18:19:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:19:40.606430 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-de9d032a-cf62-49e6-8f87-7b1a61bb9837 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "swap": 0, "ram": 1024, "vcpus": 1, "os-flavor-access:is_public": true, "name": "ds1G", "rxtx_factor": 1.0}} {{(pid=104033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:19:40.685853 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO nova.api.openstack.requestlog [None req-de9d032a-cf62-49e6-8f87-7b1a61bb9837 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.137123 Jun 14 18:19:40.691740 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: [pid: 104033|app: 0|req: 6/11] 10.222.0.78 () {64 vars in 1282 bytes} [Tue Jun 14 18:19:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 14 18:19:40.698956 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-546f45d3-45a4-4156-bd29-9b51064982b6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:19:40.781472 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO nova.api.openstack.requestlog [None req-546f45d3-45a4-4156-bd29-9b51064982b6 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085231 Jun 14 18:19:40.791329 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: [pid: 104034|app: 0|req: 6/12] 10.222.0.78 () {64 vars in 1335 bytes} [Tue Jun 14 18:19:40 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:19:43.050445 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-de9d032a-cf62-49e6-8f87-7b1a61bb9837 admin admin] Calling method '>' {{(pid=104033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:19:43.051440 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO nova.api.openstack.requestlog [None req-de9d032a-cf62-49e6-8f87-7b1a61bb9837 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001666 Jun 14 18:19:43.051877 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: [pid: 104033|app: 0|req: 7/13] 10.222.0.78 () {54 vars in 930 bytes} [Tue Jun 14 18:19:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:19:43.148670 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-77e8d3ca-c734-40ad-8c27-9adc040a9f72 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "disk": 10, "ram": 2048, "id": "d3", "os-flavor-access:is_public": true, "vcpus": 2, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=104034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:19:43.206566 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO nova.api.openstack.requestlog [None req-77e8d3ca-c734-40ad-8c27-9adc040a9f72 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.147555 Jun 14 18:19:43.207327 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: [pid: 104034|app: 0|req: 7/14] 10.222.0.78 () {64 vars in 1282 bytes} [Tue Jun 14 18:19:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 18:19:43.221300 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-655c9145-0b5a-4a8c-aced-e9cc163934cc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:19:43.307983 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO nova.api.openstack.requestlog [None req-655c9145-0b5a-4a8c-aced-e9cc163934cc admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091603 Jun 14 18:19:43.308802 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: [pid: 104033|app: 0|req: 8/15] 10.222.0.78 () {64 vars in 1335 bytes} [Tue Jun 14 18:19:43 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:19:45.597346 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-77e8d3ca-c734-40ad-8c27-9adc040a9f72 admin admin] Calling method '>' {{(pid=104034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:19:45.598380 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO nova.api.openstack.requestlog [None req-77e8d3ca-c734-40ad-8c27-9adc040a9f72 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jun 14 18:19:45.598970 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: [pid: 104034|app: 0|req: 8/16] 10.222.0.78 () {54 vars in 930 bytes} [Tue Jun 14 18:19:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:19:45.662154 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-193e069c-1469-435d-924d-9d182f13a8c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 4, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "rxtx_factor": 1.0, "disk": 20, "id": "d4", "os-flavor-access:is_public": true}} {{(pid=104033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:19:45.747105 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO nova.api.openstack.requestlog [None req-193e069c-1469-435d-924d-9d182f13a8c2 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.141964 Jun 14 18:19:45.755187 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: [pid: 104033|app: 0|req: 9/17] 10.222.0.78 () {64 vars in 1282 bytes} [Tue Jun 14 18:19:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 18:19:45.760426 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-e52d8466-2cd1-4c39-9eb7-64a5d389b07e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:19:45.850086 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO nova.api.openstack.requestlog [None req-e52d8466-2cd1-4c39-9eb7-64a5d389b07e admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093362 Jun 14 18:19:45.850668 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: [pid: 104034|app: 0|req: 9/18] 10.222.0.78 () {64 vars in 1335 bytes} [Tue Jun 14 18:19:45 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:19:48.126322 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-193e069c-1469-435d-924d-9d182f13a8c2 admin admin] Calling method '>' {{(pid=104033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:19:48.127333 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO nova.api.openstack.requestlog [None req-193e069c-1469-435d-924d-9d182f13a8c2 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001591 Jun 14 18:19:48.128009 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: [pid: 104033|app: 0|req: 10/19] 10.222.0.78 () {54 vars in 930 bytes} [Tue Jun 14 18:19:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:19:48.192686 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-deb97bc4-b521-4f04-b26f-ac17c92a50ed admin admin] Calling method '>' {{(pid=104034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:19:48.216274 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO nova.api.openstack.requestlog [None req-deb97bc4-b521-4f04-b26f-ac17c92a50ed admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.082432 Jun 14 18:19:48.216818 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: [pid: 104034|app: 0|req: 10/20] 10.222.0.78 () {60 vars in 1291 bytes} [Tue Jun 14 18:19:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:19:50.481817 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-193e069c-1469-435d-924d-9d182f13a8c2 admin admin] Calling method '>' {{(pid=104033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:19:50.483357 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO nova.api.openstack.requestlog [None req-193e069c-1469-435d-924d-9d182f13a8c2 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001568 Jun 14 18:19:50.483800 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: [pid: 104033|app: 0|req: 11/21] 10.222.0.78 () {54 vars in 930 bytes} [Tue Jun 14 18:19:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:19:50.544187 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-6b6c58e9-6f1b-4ac0-bcd1-1b9e8d7c16d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "id": "1", "name": "m1.tiny", "os-flavor-access:is_public": true, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0}} {{(pid=104034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:19:50.618615 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO nova.api.openstack.requestlog [None req-6b6c58e9-6f1b-4ac0-bcd1-1b9e8d7c16d9 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.128193 Jun 14 18:19:50.619166 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: [pid: 104034|app: 0|req: 11/22] 10.222.0.78 () {64 vars in 1282 bytes} [Tue Jun 14 18:19:50 2022] POST /compute/v2.1/flavors => generated 402 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 18:19:50.631016 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-85221dd0-2c2d-4608-a8c5-e820392ec500 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:19:50.703971 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO nova.api.openstack.requestlog [None req-85221dd0-2c2d-4608-a8c5-e820392ec500 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.076624 Jun 14 18:19:50.704559 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: [pid: 104033|app: 0|req: 12/23] 10.222.0.78 () {64 vars in 1332 bytes} [Tue Jun 14 18:19:50 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:19:52.860568 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-6b6c58e9-6f1b-4ac0-bcd1-1b9e8d7c16d9 admin admin] Calling method '>' {{(pid=104034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:19:52.861623 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO nova.api.openstack.requestlog [None req-6b6c58e9-6f1b-4ac0-bcd1-1b9e8d7c16d9 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jun 14 18:19:52.862035 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: [pid: 104034|app: 0|req: 12/24] 10.222.0.78 () {54 vars in 930 bytes} [Tue Jun 14 18:19:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:19:52.936117 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-7291b2dc-eb18-4daf-8a93-ff31582e2021 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 20, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "id": "2", "vcpus": 1}} {{(pid=104033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:19:53.240217 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO nova.api.openstack.requestlog [None req-7291b2dc-eb18-4daf-8a93-ff31582e2021 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.370488 Jun 14 18:19:53.283660 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: [pid: 104033|app: 0|req: 13/25] 10.222.0.78 () {64 vars in 1282 bytes} [Tue Jun 14 18:19:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 18:19:53.283829 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-b752997b-42fd-452d-86c6-8ed6b7e70f30 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:19:53.440806 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO nova.api.openstack.requestlog [None req-b752997b-42fd-452d-86c6-8ed6b7e70f30 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.191365 Jun 14 18:19:53.441342 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: [pid: 104034|app: 0|req: 13/26] 10.222.0.78 () {64 vars in 1332 bytes} [Tue Jun 14 18:19:53 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:19:55.640157 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-7291b2dc-eb18-4daf-8a93-ff31582e2021 admin admin] Calling method '>' {{(pid=104033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:19:55.641208 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO nova.api.openstack.requestlog [None req-7291b2dc-eb18-4daf-8a93-ff31582e2021 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002537 Jun 14 18:19:55.641806 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: [pid: 104033|app: 0|req: 14/27] 10.222.0.78 () {54 vars in 930 bytes} [Tue Jun 14 18:19:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:19:55.703173 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-95f52e2c-d6e8-45f7-a7c5-531a646dafc5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "os-flavor-access:is_public": true, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "rxtx_factor": 1.0, "vcpus": 2, "name": "m1.medium"}} {{(pid=104034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:19:55.802541 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO nova.api.openstack.requestlog [None req-95f52e2c-d6e8-45f7-a7c5-531a646dafc5 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.154784 Jun 14 18:19:55.803095 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: [pid: 104034|app: 0|req: 14/28] 10.222.0.78 () {64 vars in 1282 bytes} [Tue Jun 14 18:19:55 2022] POST /compute/v2.1/flavors => generated 406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 14 18:19:55.816071 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-3f674809-f0a4-4d5f-9349-1071071b2b52 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:19:55.891138 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO nova.api.openstack.requestlog [None req-3f674809-f0a4-4d5f-9349-1071071b2b52 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079097 Jun 14 18:19:55.891811 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: [pid: 104033|app: 0|req: 15/29] 10.222.0.78 () {64 vars in 1332 bytes} [Tue Jun 14 18:19:55 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:19:58.078793 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-95f52e2c-d6e8-45f7-a7c5-531a646dafc5 admin admin] Calling method '>' {{(pid=104034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:19:58.079933 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO nova.api.openstack.requestlog [None req-95f52e2c-d6e8-45f7-a7c5-531a646dafc5 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001601 Jun 14 18:19:58.080340 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: [pid: 104034|app: 0|req: 15/30] 10.222.0.78 () {54 vars in 930 bytes} [Tue Jun 14 18:19:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:19:58.142179 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-a56c790c-e014-4e9d-82a1-ff2bd6140627 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "swap": 0, "name": "m1.large", "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4, "ram": 8192, "rxtx_factor": 1.0}} {{(pid=104033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:19:58.233228 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO nova.api.openstack.requestlog [None req-a56c790c-e014-4e9d-82a1-ff2bd6140627 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.146086 Jun 14 18:19:58.235055 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: [pid: 104033|app: 0|req: 16/31] 10.222.0.78 () {64 vars in 1282 bytes} [Tue Jun 14 18:19:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 18:19:58.246126 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-37509ea3-1f5c-43e7-8372-72129d46af37 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:19:58.526137 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO nova.api.openstack.requestlog [None req-37509ea3-1f5c-43e7-8372-72129d46af37 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.283802 Jun 14 18:19:58.526891 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: [pid: 104034|app: 0|req: 16/32] 10.222.0.78 () {64 vars in 1332 bytes} [Tue Jun 14 18:19:58 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:20:00.772704 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-a56c790c-e014-4e9d-82a1-ff2bd6140627 admin admin] Calling method '>' {{(pid=104033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:20:00.773752 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO nova.api.openstack.requestlog [None req-a56c790c-e014-4e9d-82a1-ff2bd6140627 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 14 18:20:00.774151 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: [pid: 104033|app: 0|req: 17/33] 10.222.0.78 () {54 vars in 930 bytes} [Tue Jun 14 18:20:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:20:00.839031 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-82b9074c-fbe3-484e-a886-951cd2c6bae0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "swap": 0, "id": "5", "vcpus": 8, "disk": 160, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 16384}} {{(pid=104034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:20:00.947786 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO nova.api.openstack.requestlog [None req-82b9074c-fbe3-484e-a886-951cd2c6bae0 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.166494 Jun 14 18:20:00.948997 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: [pid: 104034|app: 0|req: 17/34] 10.222.0.78 () {64 vars in 1282 bytes} [Tue Jun 14 18:20:00 2022] POST /compute/v2.1/flavors => generated 408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 14 18:20:00.965933 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-4dd91169-1117-4ff5-a090-a1c2d713577b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:20:01.051787 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO nova.api.openstack.requestlog [None req-4dd91169-1117-4ff5-a090-a1c2d713577b admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089605 Jun 14 18:20:01.052814 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: [pid: 104033|app: 0|req: 18/35] 10.222.0.78 () {64 vars in 1332 bytes} [Tue Jun 14 18:20:00 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:20:26.133023 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-82b9074c-fbe3-484e-a886-951cd2c6bae0 admin admin] Calling method '>' {{(pid=104034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:20:26.134082 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO nova.api.openstack.requestlog [None req-82b9074c-fbe3-484e-a886-951cd2c6bae0 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Jun 14 18:20:26.134488 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: [pid: 104034|app: 0|req: 18/36] 10.222.0.78 () {54 vars in 930 bytes} [Tue Jun 14 18:20:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:20:26.145621 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG dbcounter [-] [104033] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=104033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:20:26.198214 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-0af688cd-d545-41ec-bb38-8e051c4a12c8 admin admin] Calling method '>' {{(pid=104033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:20:26.216800 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO nova.api.openstack.requestlog [None req-0af688cd-d545-41ec-bb38-8e051c4a12c8 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.075219 Jun 14 18:20:26.217349 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: [pid: 104033|app: 0|req: 19/37] 10.222.0.78 () {60 vars in 1291 bytes} [Tue Jun 14 18:20:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:20:27.230295 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-82b9074c-fbe3-484e-a886-951cd2c6bae0 admin admin] Calling method '>' {{(pid=104034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:20:27.231871 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO nova.api.openstack.requestlog [None req-82b9074c-fbe3-484e-a886-951cd2c6bae0 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Jun 14 18:20:27.232271 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: [pid: 104034|app: 0|req: 19/38] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Jun 14 18:20:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:20:27.444001 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-b306464e-e16d-40cd-841a-a99fad1f54df admin admin] Calling method '>' {{(pid=104033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:20:27.453536 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO nova.api.openstack.wsgi [None req-b306464e-e16d-40cd-841a-a99fad1f54df admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 14 18:20:27.456935 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-b306464e-e16d-40cd-841a-a99fad1f54df admin admin] Request method failure captured: Jun 14 18:20:27.456935 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 14 18:20:27.456935 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: Accept: application/json Jun 14 18:20:27.456935 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: Accept-Encoding: gzip, deflate Jun 14 18:20:27.456935 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: Connection: keep-alive Jun 14 18:20:27.456935 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: Content-Length: 0 Jun 14 18:20:27.456935 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: Host: 10.222.0.78 Jun 14 18:20:27.456935 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: Openstack-Api-Version: compute 2.90 Jun 14 18:20:27.456935 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: Openstack-System-Scope: None Jun 14 18:20:27.456935 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: User-Agent: python-novaclient Jun 14 18:20:27.456935 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Auth-Token: gAAAAABiqNFrpaO9H95aISggxdfbKEoOIxx57sg9EqkUGzwQn6hG6s_zWWhZEQp-Dsvn8XQkQgYlUzR39OgPd5ykdMezol8e-A0h0vHxzw-3obXeIv4jpSp1_QIwRQ7zsczrobx4VWRsVLne2nCN2dAWZHYgQMIbr0TDoepbMAuz7UQ7fgqPtlE Jun 14 18:20:27.456935 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Domain-Id: None Jun 14 18:20:27.456935 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Domain-Name: None Jun 14 18:20:27.456935 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Identity-Status: Confirmed Jun 14 18:20:27.456935 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Is-Admin-Project: True Jun 14 18:20:27.456935 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Openstack-Nova-Api-Version: 2.90 Jun 14 18:20:27.456935 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Project-Domain-Id: default Jun 14 18:20:27.456935 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Project-Domain-Name: Default Jun 14 18:20:27.456935 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Project-Id: dafd4afd889841cea7fe1dabcf3e3fcf Jun 14 18:20:27.456935 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Project-Name: admin Jun 14 18:20:27.456935 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Role: reader,member,admin Jun 14 18:20:27.456935 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Roles: reader,member,admin Jun 14 18:20:27.458578 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_dafd4afd889841cea7fe1dabcf3e3fcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dafd4afd889841cea7fe1dabcf3e3fcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dafd4afd889841cea7fe1dabcf3e3fcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/dafd4afd889841cea7fe1dabcf3e3fcf"}]}] Jun 14 18:20:27.458578 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Tenant: admin Jun 14 18:20:27.458578 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Tenant-Id: dafd4afd889841cea7fe1dabcf3e3fcf Jun 14 18:20:27.458578 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Tenant-Name: admin Jun 14 18:20:27.458578 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-User: admin Jun 14 18:20:27.458578 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-User-Domain-Id: default Jun 14 18:20:27.458578 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-User-Domain-Name: Default Jun 14 18:20:27.458578 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-User-Id: d13b430300734a0ca65a93e2d460ea21 Jun 14 18:20:27.458578 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-User-Name: admin Jun 14 18:20:27.458578 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: method: > Jun 14 18:20:27.458578 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: exception: Flavor 42 could not be found. Jun 14 18:20:27.458578 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: action_args: {'id': '42'} Jun 14 18:20:27.458578 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: {{(pid=104033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:20:27.458578 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:20:27.459558 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 14 18:20:27.459558 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 14 18:20:27.459558 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 14 18:20:27.459558 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 14 18:20:27.459558 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 14 18:20:27.459558 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 14 18:20:27.459558 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 14 18:20:27.459558 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 14 18:20:27.459558 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 14 18:20:27.459558 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:20:27.459558 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 14 18:20:27.459558 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 14 18:20:27.459558 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 14 18:20:27.459558 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi Jun 14 18:20:27.459558 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:20:27.459558 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi Jun 14 18:20:27.459558 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:20:27.459558 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:20:27.459558 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:20:27.460806 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:20:27.460806 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:20:27.460806 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:20:27.460806 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:20:27.460806 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 14 18:20:27.460806 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:20:27.460806 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 14 18:20:27.460806 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi Jun 14 18:20:27.460806 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:20:27.460806 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi Jun 14 18:20:27.460806 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:20:27.460806 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:20:27.460806 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:20:27.460806 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:20:27.460806 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:20:27.460806 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 14 18:20:27.460806 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi Jun 14 18:20:27.460806 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-b306464e-e16d-40cd-841a-a99fad1f54df admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:20:27.461912 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO nova.api.openstack.requestlog [None req-b306464e-e16d-40cd-841a-a99fad1f54df admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.071735 Jun 14 18:20:27.461912 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: [pid: 104033|app: 0|req: 20/39] 10.222.0.78 () {60 vars in 1190 bytes} [Tue Jun 14 18:20:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 14 18:20:27.469738 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-42280a01-a101-43f2-a332-ec5a7b8d1d30 admin admin] Calling method '>' {{(pid=104034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:20:27.472756 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG dbcounter [-] [104034] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=104034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:20:27.492591 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO nova.api.openstack.requestlog [None req-42280a01-a101-43f2-a332-ec5a7b8d1d30 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027058 Jun 14 18:20:27.493182 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: [pid: 104034|app: 0|req: 20/40] 10.222.0.78 () {60 vars in 1210 bytes} [Tue Jun 14 18:20:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:20:27.504316 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-0c2e043e-1225-4512-bea9-0e9621cbf77b admin admin] Calling method '>' {{(pid=104033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:20:27.525552 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO nova.api.openstack.requestlog [None req-0c2e043e-1225-4512-bea9-0e9621cbf77b admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025173 Jun 14 18:20:27.526111 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: [pid: 104033|app: 0|req: 21/41] 10.222.0.78 () {60 vars in 1210 bytes} [Tue Jun 14 18:20:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:20:27.536644 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-57a045cc-e308-4a87-babe-d6af0dd6c38b admin admin] Calling method '>' {{(pid=104034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:20:27.542656 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO nova.api.openstack.wsgi [None req-57a045cc-e308-4a87-babe-d6af0dd6c38b admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 14 18:20:27.546594 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-57a045cc-e308-4a87-babe-d6af0dd6c38b admin admin] Request method failure captured: Jun 14 18:20:27.546594 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 14 18:20:27.546594 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: Accept: application/json Jun 14 18:20:27.546594 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: Accept-Encoding: gzip, deflate Jun 14 18:20:27.546594 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: Connection: keep-alive Jun 14 18:20:27.546594 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: Content-Length: 0 Jun 14 18:20:27.546594 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: Host: 10.222.0.78 Jun 14 18:20:27.546594 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: Openstack-Api-Version: compute 2.90 Jun 14 18:20:27.546594 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: Openstack-System-Scope: None Jun 14 18:20:27.546594 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: User-Agent: python-novaclient Jun 14 18:20:27.546594 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Auth-Token: gAAAAABiqNFrpaO9H95aISggxdfbKEoOIxx57sg9EqkUGzwQn6hG6s_zWWhZEQp-Dsvn8XQkQgYlUzR39OgPd5ykdMezol8e-A0h0vHxzw-3obXeIv4jpSp1_QIwRQ7zsczrobx4VWRsVLne2nCN2dAWZHYgQMIbr0TDoepbMAuz7UQ7fgqPtlE Jun 14 18:20:27.546594 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Domain-Id: None Jun 14 18:20:27.546594 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Domain-Name: None Jun 14 18:20:27.546594 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Identity-Status: Confirmed Jun 14 18:20:27.546594 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Is-Admin-Project: True Jun 14 18:20:27.546594 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Openstack-Nova-Api-Version: 2.90 Jun 14 18:20:27.546594 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Project-Domain-Id: default Jun 14 18:20:27.546594 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Project-Domain-Name: Default Jun 14 18:20:27.546594 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Project-Id: dafd4afd889841cea7fe1dabcf3e3fcf Jun 14 18:20:27.546594 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Project-Name: admin Jun 14 18:20:27.546594 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Role: reader,member,admin Jun 14 18:20:27.546594 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Roles: reader,member,admin Jun 14 18:20:27.548491 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_dafd4afd889841cea7fe1dabcf3e3fcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dafd4afd889841cea7fe1dabcf3e3fcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dafd4afd889841cea7fe1dabcf3e3fcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/dafd4afd889841cea7fe1dabcf3e3fcf"}]}] Jun 14 18:20:27.548491 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Tenant: admin Jun 14 18:20:27.548491 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Tenant-Id: dafd4afd889841cea7fe1dabcf3e3fcf Jun 14 18:20:27.548491 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Tenant-Name: admin Jun 14 18:20:27.548491 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-User: admin Jun 14 18:20:27.548491 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-User-Domain-Id: default Jun 14 18:20:27.548491 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-User-Domain-Name: Default Jun 14 18:20:27.548491 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-User-Id: d13b430300734a0ca65a93e2d460ea21 Jun 14 18:20:27.548491 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-User-Name: admin Jun 14 18:20:27.548491 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: method: > Jun 14 18:20:27.548491 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: exception: Flavor 42 could not be found. Jun 14 18:20:27.548491 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: action_args: {'id': '42'} Jun 14 18:20:27.548491 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: {{(pid=104034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:20:27.548491 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:20:27.549427 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 14 18:20:27.549427 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 14 18:20:27.549427 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 14 18:20:27.549427 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 14 18:20:27.549427 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 14 18:20:27.549427 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 14 18:20:27.549427 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 14 18:20:27.549427 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 14 18:20:27.549427 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 14 18:20:27.549427 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:20:27.549427 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 14 18:20:27.549427 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 14 18:20:27.549427 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 14 18:20:27.549427 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi Jun 14 18:20:27.549427 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:20:27.549427 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi Jun 14 18:20:27.549427 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:20:27.549427 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:20:27.549427 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:20:27.554941 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:20:27.554941 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:20:27.554941 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:20:27.554941 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:20:27.554941 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 14 18:20:27.554941 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:20:27.554941 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 14 18:20:27.554941 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi Jun 14 18:20:27.554941 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:20:27.554941 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi Jun 14 18:20:27.554941 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:20:27.554941 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:20:27.554941 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:20:27.554941 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:20:27.554941 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:20:27.554941 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 14 18:20:27.554941 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi Jun 14 18:20:27.554941 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-57a045cc-e308-4a87-babe-d6af0dd6c38b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104034) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:20:27.556219 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO nova.api.openstack.requestlog [None req-57a045cc-e308-4a87-babe-d6af0dd6c38b admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015261 Jun 14 18:20:27.556219 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: [pid: 104034|app: 0|req: 21/42] 10.222.0.78 () {60 vars in 1190 bytes} [Tue Jun 14 18:20:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 14 18:20:28.429720 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-0c2e043e-1225-4512-bea9-0e9621cbf77b admin admin] Calling method '>' {{(pid=104033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:20:28.430766 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO nova.api.openstack.requestlog [None req-0c2e043e-1225-4512-bea9-0e9621cbf77b admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Jun 14 18:20:28.431162 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: [pid: 104033|app: 0|req: 22/43] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Jun 14 18:20:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:20:28.627198 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-efd37320-2392-4665-9433-44d1ed152737 admin admin] Calling method '>' {{(pid=104034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:20:28.632755 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO nova.api.openstack.wsgi [None req-efd37320-2392-4665-9433-44d1ed152737 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 14 18:20:28.634302 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-efd37320-2392-4665-9433-44d1ed152737 admin admin] Request method failure captured: Jun 14 18:20:28.634302 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 14 18:20:28.634302 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: Accept: application/json Jun 14 18:20:28.634302 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: Accept-Encoding: gzip, deflate Jun 14 18:20:28.634302 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: Connection: keep-alive Jun 14 18:20:28.634302 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: Content-Length: 0 Jun 14 18:20:28.634302 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: Host: 10.222.0.78 Jun 14 18:20:28.634302 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: Openstack-Api-Version: compute 2.90 Jun 14 18:20:28.634302 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: Openstack-System-Scope: None Jun 14 18:20:28.634302 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: User-Agent: python-novaclient Jun 14 18:20:28.634302 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Auth-Token: gAAAAABiqNFsvpSjsbtlLNlpAIUAqHvo_mdlspEondOKtDoraXpg6Qt1Vv9Lhj0irlZtNgfFWfT8nr60n6TvS9z381ymI7T2EUgB4BXQBH845BujBLtn38McnO4Kjv_xF8Grd3hfi2ykViy2w1QSz7ZNA2TKqEWFC0v3L8NJFiawhqzHyUzQBPA Jun 14 18:20:28.634302 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Domain-Id: None Jun 14 18:20:28.634302 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Domain-Name: None Jun 14 18:20:28.634302 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Identity-Status: Confirmed Jun 14 18:20:28.634302 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Is-Admin-Project: True Jun 14 18:20:28.634302 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Openstack-Nova-Api-Version: 2.90 Jun 14 18:20:28.634302 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Project-Domain-Id: default Jun 14 18:20:28.634302 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Project-Domain-Name: Default Jun 14 18:20:28.634302 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Project-Id: dafd4afd889841cea7fe1dabcf3e3fcf Jun 14 18:20:28.634302 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Project-Name: admin Jun 14 18:20:28.634302 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Role: reader,member,admin Jun 14 18:20:28.634302 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Roles: reader,member,admin Jun 14 18:20:28.635804 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_dafd4afd889841cea7fe1dabcf3e3fcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dafd4afd889841cea7fe1dabcf3e3fcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dafd4afd889841cea7fe1dabcf3e3fcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/dafd4afd889841cea7fe1dabcf3e3fcf"}]}] Jun 14 18:20:28.635804 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Tenant: admin Jun 14 18:20:28.635804 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Tenant-Id: dafd4afd889841cea7fe1dabcf3e3fcf Jun 14 18:20:28.635804 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Tenant-Name: admin Jun 14 18:20:28.635804 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-User: admin Jun 14 18:20:28.635804 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-User-Domain-Id: default Jun 14 18:20:28.635804 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-User-Domain-Name: Default Jun 14 18:20:28.635804 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-User-Id: d13b430300734a0ca65a93e2d460ea21 Jun 14 18:20:28.635804 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-User-Name: admin Jun 14 18:20:28.635804 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: method: > Jun 14 18:20:28.635804 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: exception: Flavor 84 could not be found. Jun 14 18:20:28.635804 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: action_args: {'id': '84'} Jun 14 18:20:28.635804 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: {{(pid=104034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:20:28.635804 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:20:28.636847 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 14 18:20:28.636847 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 14 18:20:28.636847 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 14 18:20:28.636847 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 14 18:20:28.636847 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 14 18:20:28.636847 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 14 18:20:28.636847 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 14 18:20:28.636847 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 14 18:20:28.636847 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 14 18:20:28.636847 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:20:28.636847 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 14 18:20:28.636847 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 14 18:20:28.636847 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 14 18:20:28.636847 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi Jun 14 18:20:28.636847 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:20:28.636847 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi Jun 14 18:20:28.636847 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:20:28.636847 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:20:28.636847 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:20:28.638632 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:20:28.638632 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:20:28.638632 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:20:28.638632 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:20:28.638632 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 14 18:20:28.638632 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:20:28.638632 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 14 18:20:28.638632 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi Jun 14 18:20:28.638632 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:20:28.638632 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi Jun 14 18:20:28.638632 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:20:28.638632 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:20:28.638632 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:20:28.638632 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:20:28.638632 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:20:28.638632 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 14 18:20:28.638632 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi Jun 14 18:20:28.638632 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-efd37320-2392-4665-9433-44d1ed152737 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104034) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:20:28.639699 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO nova.api.openstack.requestlog [None req-efd37320-2392-4665-9433-44d1ed152737 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.065344 Jun 14 18:20:28.639699 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: [pid: 104034|app: 0|req: 22/44] 10.222.0.78 () {60 vars in 1190 bytes} [Tue Jun 14 18:20:28 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 14 18:20:28.646079 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-0b176995-de75-4e76-9d0e-59d0f1ac6d75 admin admin] Calling method '>' {{(pid=104033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:20:28.662136 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO nova.api.openstack.requestlog [None req-0b176995-de75-4e76-9d0e-59d0f1ac6d75 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019581 Jun 14 18:20:28.662696 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: [pid: 104033|app: 0|req: 23/45] 10.222.0.78 () {60 vars in 1210 bytes} [Tue Jun 14 18:20:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:20:28.673000 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-963b2ba8-9471-4be8-a39a-42d6e2e63522 admin admin] Calling method '>' {{(pid=104034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:20:28.687903 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO nova.api.openstack.requestlog [None req-963b2ba8-9471-4be8-a39a-42d6e2e63522 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018683 Jun 14 18:20:28.688463 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: [pid: 104034|app: 0|req: 23/46] 10.222.0.78 () {60 vars in 1210 bytes} [Tue Jun 14 18:20:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:20:28.698650 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-730d6a60-7c7e-4013-b6bf-051265abab3b admin admin] Calling method '>' {{(pid=104033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:20:28.704606 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO nova.api.openstack.wsgi [None req-730d6a60-7c7e-4013-b6bf-051265abab3b admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 14 18:20:28.706165 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-730d6a60-7c7e-4013-b6bf-051265abab3b admin admin] Request method failure captured: Jun 14 18:20:28.706165 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 14 18:20:28.706165 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: Accept: application/json Jun 14 18:20:28.706165 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: Accept-Encoding: gzip, deflate Jun 14 18:20:28.706165 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: Connection: keep-alive Jun 14 18:20:28.706165 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: Content-Length: 0 Jun 14 18:20:28.706165 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: Host: 10.222.0.78 Jun 14 18:20:28.706165 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: Openstack-Api-Version: compute 2.90 Jun 14 18:20:28.706165 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: Openstack-System-Scope: None Jun 14 18:20:28.706165 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: User-Agent: python-novaclient Jun 14 18:20:28.706165 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Auth-Token: gAAAAABiqNFsvpSjsbtlLNlpAIUAqHvo_mdlspEondOKtDoraXpg6Qt1Vv9Lhj0irlZtNgfFWfT8nr60n6TvS9z381ymI7T2EUgB4BXQBH845BujBLtn38McnO4Kjv_xF8Grd3hfi2ykViy2w1QSz7ZNA2TKqEWFC0v3L8NJFiawhqzHyUzQBPA Jun 14 18:20:28.706165 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Domain-Id: None Jun 14 18:20:28.706165 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Domain-Name: None Jun 14 18:20:28.706165 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Identity-Status: Confirmed Jun 14 18:20:28.706165 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Is-Admin-Project: True Jun 14 18:20:28.706165 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Openstack-Nova-Api-Version: 2.90 Jun 14 18:20:28.706165 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Project-Domain-Id: default Jun 14 18:20:28.706165 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Project-Domain-Name: Default Jun 14 18:20:28.706165 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Project-Id: dafd4afd889841cea7fe1dabcf3e3fcf Jun 14 18:20:28.706165 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Project-Name: admin Jun 14 18:20:28.706165 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Role: reader,member,admin Jun 14 18:20:28.706165 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Roles: reader,member,admin Jun 14 18:20:28.707698 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_dafd4afd889841cea7fe1dabcf3e3fcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dafd4afd889841cea7fe1dabcf3e3fcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dafd4afd889841cea7fe1dabcf3e3fcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/dafd4afd889841cea7fe1dabcf3e3fcf"}]}] Jun 14 18:20:28.707698 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Tenant: admin Jun 14 18:20:28.707698 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Tenant-Id: dafd4afd889841cea7fe1dabcf3e3fcf Jun 14 18:20:28.707698 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Tenant-Name: admin Jun 14 18:20:28.707698 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-User: admin Jun 14 18:20:28.707698 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-User-Domain-Id: default Jun 14 18:20:28.707698 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-User-Domain-Name: Default Jun 14 18:20:28.707698 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-User-Id: d13b430300734a0ca65a93e2d460ea21 Jun 14 18:20:28.707698 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-User-Name: admin Jun 14 18:20:28.707698 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: method: > Jun 14 18:20:28.707698 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: exception: Flavor 84 could not be found. Jun 14 18:20:28.707698 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: action_args: {'id': '84'} Jun 14 18:20:28.707698 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: {{(pid=104033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:20:28.707698 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:20:28.708634 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 14 18:20:28.708634 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 14 18:20:28.708634 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 14 18:20:28.708634 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 14 18:20:28.708634 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 14 18:20:28.708634 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 14 18:20:28.708634 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 14 18:20:28.708634 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 14 18:20:28.708634 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 14 18:20:28.708634 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:20:28.708634 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 14 18:20:28.708634 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 14 18:20:28.708634 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 14 18:20:28.708634 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi Jun 14 18:20:28.708634 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:20:28.708634 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi Jun 14 18:20:28.708634 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:20:28.708634 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:20:28.708634 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:20:28.710080 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:20:28.710080 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:20:28.710080 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:20:28.710080 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:20:28.710080 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 14 18:20:28.710080 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:20:28.710080 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 14 18:20:28.710080 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi Jun 14 18:20:28.710080 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:20:28.710080 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi Jun 14 18:20:28.710080 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:20:28.710080 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:20:28.710080 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:20:28.710080 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:20:28.710080 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:20:28.710080 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 14 18:20:28.710080 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi Jun 14 18:20:28.710080 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-730d6a60-7c7e-4013-b6bf-051265abab3b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:20:28.711309 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO nova.api.openstack.requestlog [None req-730d6a60-7c7e-4013-b6bf-051265abab3b admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012509 Jun 14 18:20:28.711309 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: [pid: 104033|app: 0|req: 24/47] 10.222.0.78 () {60 vars in 1190 bytes} [Tue Jun 14 18:20:28 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 14 18:20:29.588856 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-963b2ba8-9471-4be8-a39a-42d6e2e63522 admin admin] Calling method '>' {{(pid=104034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:20:29.589906 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO nova.api.openstack.requestlog [None req-963b2ba8-9471-4be8-a39a-42d6e2e63522 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jun 14 18:20:29.590293 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: [pid: 104034|app: 0|req: 24/48] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Jun 14 18:20:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:20:29.789809 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-fd32059c-6b10-4326-a2da-b1d403ecbd4b admin admin] Calling method '>' {{(pid=104033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:20:29.796426 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO nova.api.openstack.wsgi [None req-fd32059c-6b10-4326-a2da-b1d403ecbd4b admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 14 18:20:29.798265 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-fd32059c-6b10-4326-a2da-b1d403ecbd4b admin admin] Request method failure captured: Jun 14 18:20:29.798265 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 14 18:20:29.798265 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: Accept: application/json Jun 14 18:20:29.798265 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: Accept-Encoding: gzip, deflate Jun 14 18:20:29.798265 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: Connection: keep-alive Jun 14 18:20:29.798265 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: Content-Length: 0 Jun 14 18:20:29.798265 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: Host: 10.222.0.78 Jun 14 18:20:29.798265 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: Openstack-Api-Version: compute 2.90 Jun 14 18:20:29.798265 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: Openstack-System-Scope: None Jun 14 18:20:29.798265 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: User-Agent: python-novaclient Jun 14 18:20:29.798265 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Auth-Token: gAAAAABiqNFtlVHuTOeRJsWo2-L_NcfsP39KYLbe4s2-PD9lmnfqGiGAx6moWrxWGe6CGz1Ag7c2_vvs7xt_jt2btb9GQ903nEpB3-In-7BqseDsyD3ROl0rhuhlwE-Yozj8LPKkxMp44zmI64gEHxglkY7F0OUTb3cEn6GusDkH_9uOmj22l08 Jun 14 18:20:29.798265 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Domain-Id: None Jun 14 18:20:29.798265 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Domain-Name: None Jun 14 18:20:29.798265 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Identity-Status: Confirmed Jun 14 18:20:29.798265 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Is-Admin-Project: True Jun 14 18:20:29.798265 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Openstack-Nova-Api-Version: 2.90 Jun 14 18:20:29.798265 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Project-Domain-Id: default Jun 14 18:20:29.798265 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Project-Domain-Name: Default Jun 14 18:20:29.798265 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Project-Id: dafd4afd889841cea7fe1dabcf3e3fcf Jun 14 18:20:29.798265 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Project-Name: admin Jun 14 18:20:29.798265 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Role: reader,member,admin Jun 14 18:20:29.798265 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Roles: reader,member,admin Jun 14 18:20:29.799683 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_dafd4afd889841cea7fe1dabcf3e3fcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dafd4afd889841cea7fe1dabcf3e3fcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dafd4afd889841cea7fe1dabcf3e3fcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/dafd4afd889841cea7fe1dabcf3e3fcf"}]}] Jun 14 18:20:29.799683 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Tenant: admin Jun 14 18:20:29.799683 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Tenant-Id: dafd4afd889841cea7fe1dabcf3e3fcf Jun 14 18:20:29.799683 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-Tenant-Name: admin Jun 14 18:20:29.799683 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-User: admin Jun 14 18:20:29.799683 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-User-Domain-Id: default Jun 14 18:20:29.799683 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-User-Domain-Name: Default Jun 14 18:20:29.799683 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-User-Id: d13b430300734a0ca65a93e2d460ea21 Jun 14 18:20:29.799683 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: X-User-Name: admin Jun 14 18:20:29.799683 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: method: > Jun 14 18:20:29.799683 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: exception: Flavor 451 could not be found. Jun 14 18:20:29.799683 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: action_args: {'id': '451'} Jun 14 18:20:29.799683 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: {{(pid=104033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:20:29.799683 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:20:29.800515 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 14 18:20:29.800515 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 14 18:20:29.800515 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 14 18:20:29.800515 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 14 18:20:29.800515 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 14 18:20:29.800515 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 14 18:20:29.800515 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 14 18:20:29.800515 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 14 18:20:29.800515 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 14 18:20:29.800515 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:20:29.800515 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 14 18:20:29.800515 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 14 18:20:29.800515 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 14 18:20:29.800515 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi Jun 14 18:20:29.800515 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:20:29.800515 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi Jun 14 18:20:29.800515 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:20:29.800515 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:20:29.800515 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:20:29.802160 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:20:29.802160 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:20:29.802160 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:20:29.802160 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:20:29.802160 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 14 18:20:29.802160 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:20:29.802160 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 14 18:20:29.802160 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi Jun 14 18:20:29.802160 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:20:29.802160 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi Jun 14 18:20:29.802160 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:20:29.802160 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:20:29.802160 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:20:29.802160 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:20:29.802160 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:20:29.802160 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 14 18:20:29.802160 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: ERROR nova.api.openstack.wsgi Jun 14 18:20:29.802160 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-fd32059c-6b10-4326-a2da-b1d403ecbd4b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:20:29.803204 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO nova.api.openstack.requestlog [None req-fd32059c-6b10-4326-a2da-b1d403ecbd4b admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.066318 Jun 14 18:20:29.803204 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: [pid: 104033|app: 0|req: 25/49] 10.222.0.78 () {60 vars in 1193 bytes} [Tue Jun 14 18:20:29 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 14 18:20:29.811325 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-3e09e946-3f11-4e1c-88b7-1df99f6f0a3d admin admin] Calling method '>' {{(pid=104034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:20:29.825500 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO nova.api.openstack.requestlog [None req-3e09e946-3f11-4e1c-88b7-1df99f6f0a3d admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018351 Jun 14 18:20:29.826167 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: [pid: 104034|app: 0|req: 25/50] 10.222.0.78 () {60 vars in 1210 bytes} [Tue Jun 14 18:20:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:20:29.836137 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-db5eae3d-286c-4cf1-adc2-d9b6170757be admin admin] Calling method '>' {{(pid=104033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:20:29.850891 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO nova.api.openstack.requestlog [None req-db5eae3d-286c-4cf1-adc2-d9b6170757be admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018417 Jun 14 18:20:29.851439 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: [pid: 104033|app: 0|req: 26/51] 10.222.0.78 () {60 vars in 1210 bytes} [Tue Jun 14 18:20:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:20:29.861386 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-104c342e-00ed-4370-9dcb-7adc453b7e6d admin admin] Calling method '>' {{(pid=104034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:20:29.866926 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO nova.api.openstack.wsgi [None req-104c342e-00ed-4370-9dcb-7adc453b7e6d admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 14 18:20:29.868412 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-104c342e-00ed-4370-9dcb-7adc453b7e6d admin admin] Request method failure captured: Jun 14 18:20:29.868412 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 14 18:20:29.868412 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: Accept: application/json Jun 14 18:20:29.868412 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: Accept-Encoding: gzip, deflate Jun 14 18:20:29.868412 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: Connection: keep-alive Jun 14 18:20:29.868412 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: Content-Length: 0 Jun 14 18:20:29.868412 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: Host: 10.222.0.78 Jun 14 18:20:29.868412 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: Openstack-Api-Version: compute 2.90 Jun 14 18:20:29.868412 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: Openstack-System-Scope: None Jun 14 18:20:29.868412 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: User-Agent: python-novaclient Jun 14 18:20:29.868412 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Auth-Token: gAAAAABiqNFtlVHuTOeRJsWo2-L_NcfsP39KYLbe4s2-PD9lmnfqGiGAx6moWrxWGe6CGz1Ag7c2_vvs7xt_jt2btb9GQ903nEpB3-In-7BqseDsyD3ROl0rhuhlwE-Yozj8LPKkxMp44zmI64gEHxglkY7F0OUTb3cEn6GusDkH_9uOmj22l08 Jun 14 18:20:29.868412 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Domain-Id: None Jun 14 18:20:29.868412 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Domain-Name: None Jun 14 18:20:29.868412 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Identity-Status: Confirmed Jun 14 18:20:29.868412 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Is-Admin-Project: True Jun 14 18:20:29.868412 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Openstack-Nova-Api-Version: 2.90 Jun 14 18:20:29.868412 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Project-Domain-Id: default Jun 14 18:20:29.868412 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Project-Domain-Name: Default Jun 14 18:20:29.868412 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Project-Id: dafd4afd889841cea7fe1dabcf3e3fcf Jun 14 18:20:29.868412 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Project-Name: admin Jun 14 18:20:29.868412 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Role: reader,member,admin Jun 14 18:20:29.868412 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Roles: reader,member,admin Jun 14 18:20:29.869961 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_dafd4afd889841cea7fe1dabcf3e3fcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dafd4afd889841cea7fe1dabcf3e3fcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dafd4afd889841cea7fe1dabcf3e3fcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/dafd4afd889841cea7fe1dabcf3e3fcf"}]}] Jun 14 18:20:29.869961 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Tenant: admin Jun 14 18:20:29.869961 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Tenant-Id: dafd4afd889841cea7fe1dabcf3e3fcf Jun 14 18:20:29.869961 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-Tenant-Name: admin Jun 14 18:20:29.869961 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-User: admin Jun 14 18:20:29.869961 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-User-Domain-Id: default Jun 14 18:20:29.869961 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-User-Domain-Name: Default Jun 14 18:20:29.869961 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-User-Id: d13b430300734a0ca65a93e2d460ea21 Jun 14 18:20:29.869961 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: X-User-Name: admin Jun 14 18:20:29.869961 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: method: > Jun 14 18:20:29.869961 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: exception: Flavor 451 could not be found. Jun 14 18:20:29.869961 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: action_args: {'id': '451'} Jun 14 18:20:29.869961 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: {{(pid=104034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:20:29.869961 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:20:29.871031 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 14 18:20:29.871031 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 14 18:20:29.871031 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 14 18:20:29.871031 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 14 18:20:29.871031 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 14 18:20:29.871031 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 14 18:20:29.871031 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 14 18:20:29.871031 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 14 18:20:29.871031 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 14 18:20:29.871031 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:20:29.871031 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 14 18:20:29.871031 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 14 18:20:29.871031 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 14 18:20:29.871031 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi Jun 14 18:20:29.871031 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:20:29.871031 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi Jun 14 18:20:29.871031 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:20:29.871031 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:20:29.871031 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:20:29.872508 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:20:29.872508 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:20:29.872508 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:20:29.872508 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:20:29.872508 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 14 18:20:29.872508 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:20:29.872508 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 14 18:20:29.872508 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi Jun 14 18:20:29.872508 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:20:29.872508 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi Jun 14 18:20:29.872508 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:20:29.872508 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:20:29.872508 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:20:29.872508 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:20:29.872508 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:20:29.872508 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 14 18:20:29.872508 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: ERROR nova.api.openstack.wsgi Jun 14 18:20:29.872508 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-104c342e-00ed-4370-9dcb-7adc453b7e6d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104034) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:20:29.873720 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO nova.api.openstack.requestlog [None req-104c342e-00ed-4370-9dcb-7adc453b7e6d admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012019 Jun 14 18:20:29.873720 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: [pid: 104034|app: 0|req: 26/52] 10.222.0.78 () {60 vars in 1193 bytes} [Tue Jun 14 18:20:29 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 14 18:20:30.751069 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-db5eae3d-286c-4cf1-adc2-d9b6170757be admin admin] Calling method '>' {{(pid=104033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:20:30.752070 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO nova.api.openstack.requestlog [None req-db5eae3d-286c-4cf1-adc2-d9b6170757be admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jun 14 18:20:30.752496 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: [pid: 104033|app: 0|req: 27/53] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Jun 14 18:20:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:20:30.944977 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-a00d044f-4fcb-4358-99e6-7a1f8f48d11d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:20:31.036832 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO nova.api.openstack.requestlog [None req-a00d044f-4fcb-4358-99e6-7a1f8f48d11d admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.144796 Jun 14 18:20:31.037314 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: [pid: 104034|app: 0|req: 27/54] 10.222.0.78 () {64 vars in 1235 bytes} [Tue Jun 14 18:20:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 18:20:31.926433 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-db5eae3d-286c-4cf1-adc2-d9b6170757be admin admin] Calling method '>' {{(pid=104033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:20:31.927443 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO nova.api.openstack.requestlog [None req-db5eae3d-286c-4cf1-adc2-d9b6170757be admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jun 14 18:20:31.927852 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: [pid: 104033|app: 0|req: 28/55] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Jun 14 18:20:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:20:32.122748 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-817536b5-62f8-490f-957a-52f2815d80ce admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:20:32.225490 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO nova.api.openstack.requestlog [None req-817536b5-62f8-490f-957a-52f2815d80ce admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.158818 Jun 14 18:20:32.226044 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: [pid: 104034|app: 0|req: 28/56] 10.222.0.78 () {64 vars in 1235 bytes} [Tue Jun 14 18:20:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 18:20:33.138748 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-db5eae3d-286c-4cf1-adc2-d9b6170757be admin admin] Calling method '>' {{(pid=104033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:20:33.139746 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO nova.api.openstack.requestlog [None req-db5eae3d-286c-4cf1-adc2-d9b6170757be admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jun 14 18:20:33.140176 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: [pid: 104033|app: 0|req: 29/57] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Jun 14 18:20:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:20:33.344361 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-8f813183-bb20-4feb-86f6-5217202a731a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:20:33.420027 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO nova.api.openstack.requestlog [None req-8f813183-bb20-4feb-86f6-5217202a731a admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.135683 Jun 14 18:20:33.420596 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: [pid: 104034|app: 0|req: 29/58] 10.222.0.78 () {64 vars in 1235 bytes} [Tue Jun 14 18:20:33 2022] POST /compute/v2.1/flavors => generated 407 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 18:20:34.320877 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-db5eae3d-286c-4cf1-adc2-d9b6170757be admin admin] Calling method '>' {{(pid=104033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:20:34.321971 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO nova.api.openstack.requestlog [None req-db5eae3d-286c-4cf1-adc2-d9b6170757be admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Jun 14 18:20:34.322374 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: [pid: 104033|app: 0|req: 30/59] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Jun 14 18:20:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:20:34.529325 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-9f031db9-0b36-492d-af0e-6e259979d8fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:20:34.631067 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO nova.api.openstack.requestlog [None req-9f031db9-0b36-492d-af0e-6e259979d8fe admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.155716 Jun 14 18:20:34.631516 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: [pid: 104034|app: 0|req: 30/60] 10.222.0.78 () {64 vars in 1235 bytes} [Tue Jun 14 18:20:34 2022] POST /compute/v2.1/flavors => generated 409 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 18:20:35.513649 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-db5eae3d-286c-4cf1-adc2-d9b6170757be admin admin] Calling method '>' {{(pid=104033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:20:35.514767 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO nova.api.openstack.requestlog [None req-db5eae3d-286c-4cf1-adc2-d9b6170757be admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001597 Jun 14 18:20:35.515173 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: [pid: 104033|app: 0|req: 31/61] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Jun 14 18:20:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:20:35.707437 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-49d3db03-cb5f-4e99-929c-0b539b7deba2 admin admin] Calling method '>' {{(pid=104034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:20:35.727661 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO nova.api.openstack.requestlog [None req-49d3db03-cb5f-4e99-929c-0b539b7deba2 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.073507 Jun 14 18:20:35.728128 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: [pid: 104034|app: 0|req: 31/62] 10.222.0.78 () {60 vars in 1202 bytes} [Tue Jun 14 18:20:35 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:21:24.236556 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-db5eae3d-286c-4cf1-adc2-d9b6170757be admin admin] Calling method '>' {{(pid=104033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:21:24.237623 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO nova.api.openstack.requestlog [None req-db5eae3d-286c-4cf1-adc2-d9b6170757be admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jun 14 18:21:24.238019 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: [pid: 104033|app: 0|req: 32/63] 10.222.0.78 () {54 vars in 930 bytes} [Tue Jun 14 18:21:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:21:24.248110 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG dbcounter [-] [104034] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=104034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:21:24.298354 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-788a520b-183e-430d-84ce-94d27aaea586 admin admin] Calling method '>' {{(pid=104034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:21:24.318377 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO nova.api.openstack.requestlog [None req-788a520b-183e-430d-84ce-94d27aaea586 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.074699 Jun 14 18:21:24.318911 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: [pid: 104034|app: 0|req: 32/64] 10.222.0.78 () {60 vars in 1291 bytes} [Tue Jun 14 18:21:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:21:24.342713 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-602726da-02d5-4c06-b6f0-192cb4335e72 admin admin] Calling method '>' {{(pid=104033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:21:24.346256 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG dbcounter [-] [104033] Writing DB stats nova_api:SELECT=14 {{(pid=104033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:21:24.351394 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO nova.api.openstack.requestlog [None req-602726da-02d5-4c06-b6f0-192cb4335e72 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012781 Jun 14 18:21:24.351952 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: [pid: 104033|app: 0|req: 33/65] 10.222.0.78 () {60 vars in 1282 bytes} [Tue Jun 14 18:21:24 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:21:24.366637 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-aa0f10f6-a8bc-4a7a-b1f6-bf67a91c0a66 admin admin] Calling method '>' {{(pid=104034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:21:24.374980 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO nova.api.openstack.requestlog [None req-aa0f10f6-a8bc-4a7a-b1f6-bf67a91c0a66 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012212 Jun 14 18:21:24.375518 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: [pid: 104034|app: 0|req: 33/66] 10.222.0.78 () {60 vars in 1285 bytes} [Tue Jun 14 18:21:24 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:21:24.387773 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-2674408f-ec9c-4295-9f5e-2ff066c642fa admin admin] Calling method '>' {{(pid=104033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:21:24.395605 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO nova.api.openstack.requestlog [None req-2674408f-ec9c-4295-9f5e-2ff066c642fa admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012158 Jun 14 18:21:24.396124 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: [pid: 104033|app: 0|req: 34/67] 10.222.0.78 () {60 vars in 1285 bytes} [Tue Jun 14 18:21:24 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:21:24.407657 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-cd311c47-8df3-4211-a48b-ea2245c7c1b7 admin admin] Calling method '>' {{(pid=104034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:21:24.415263 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO nova.api.openstack.requestlog [None req-cd311c47-8df3-4211-a48b-ea2245c7c1b7 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011227 Jun 14 18:21:24.415853 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: [pid: 104034|app: 0|req: 34/68] 10.222.0.78 () {60 vars in 1282 bytes} [Tue Jun 14 18:21:24 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:24:57.304121 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-2674408f-ec9c-4295-9f5e-2ff066c642fa admin admin] Calling method '>' {{(pid=104033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:24:57.305135 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO nova.api.openstack.requestlog [None req-2674408f-ec9c-4295-9f5e-2ff066c642fa admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jun 14 18:24:57.305701 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: [pid: 104033|app: 0|req: 35/69] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Jun 14 18:24:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:24:57.465955 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG dbcounter [-] [104034] Writing DB stats nova_api:SELECT=6 {{(pid=104034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:24:57.586309 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-a8b10b76-0759-412f-b970-4b1a84bfba1f admin admin] Calling method '>' {{(pid=104034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:24:57.587567 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 14 18:24:57.587567 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: warnings.warn(msg) Jun 14 18:24:57.589887 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG oslo_concurrency.lockutils [None req-a8b10b76-0759-412f-b970-4b1a84bfba1f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:24:57.590372 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG oslo_concurrency.lockutils [None req-a8b10b76-0759-412f-b970-4b1a84bfba1f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=104034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:24:57.591323 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG oslo_concurrency.lockutils [None req-a8b10b76-0759-412f-b970-4b1a84bfba1f admin admin] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:24:57.591807 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG oslo_concurrency.lockutils [None req-a8b10b76-0759-412f-b970-4b1a84bfba1f admin admin] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=104034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:24:57.625122 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO nova.api.openstack.requestlog [None req-a8b10b76-0759-412f-b970-4b1a84bfba1f admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.161452 Jun 14 18:24:57.625720 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: [pid: 104034|app: 0|req: 35/70] 10.222.0.78 () {60 vars in 1193 bytes} [Tue Jun 14 18:24:57 2022] GET /compute/v2.1/os-services => generated 791 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 18:24:58.519107 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-2674408f-ec9c-4295-9f5e-2ff066c642fa admin admin] Calling method '>' {{(pid=104033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:24:58.520112 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO nova.api.openstack.requestlog [None req-2674408f-ec9c-4295-9f5e-2ff066c642fa admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jun 14 18:24:58.520765 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: [pid: 104033|app: 0|req: 36/71] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Jun 14 18:24:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:24:58.714374 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-644fa2c1-85e6-4075-8530-150fbda70f7c admin admin] Calling method '>' {{(pid=104034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:24:58.715879 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 14 18:24:58.715879 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: warnings.warn(msg) Jun 14 18:24:58.717062 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG oslo_concurrency.lockutils [None req-644fa2c1-85e6-4075-8530-150fbda70f7c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:24:58.717518 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG oslo_concurrency.lockutils [None req-644fa2c1-85e6-4075-8530-150fbda70f7c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:24:58.718330 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG oslo_concurrency.lockutils [None req-644fa2c1-85e6-4075-8530-150fbda70f7c admin admin] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:24:58.718753 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG oslo_concurrency.lockutils [None req-644fa2c1-85e6-4075-8530-150fbda70f7c admin admin] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:24:58.742813 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO nova.api.openstack.requestlog [None req-644fa2c1-85e6-4075-8530-150fbda70f7c admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.081257 Jun 14 18:24:58.743392 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: [pid: 104034|app: 0|req: 36/72] 10.222.0.78 () {60 vars in 1193 bytes} [Tue Jun 14 18:24:58 2022] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 18:25:10.050630 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-2674408f-ec9c-4295-9f5e-2ff066c642fa admin admin] Calling method '>' {{(pid=104033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:25:10.051707 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO nova.api.openstack.requestlog [None req-2674408f-ec9c-4295-9f5e-2ff066c642fa admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Jun 14 18:25:10.052111 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: [pid: 104033|app: 0|req: 37/73] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Jun 14 18:25:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:25:10.197492 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG dbcounter [-] [104034] Writing DB stats nova_cell0:SELECT=4 {{(pid=104034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:25:10.198141 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG dbcounter [-] [104034] Writing DB stats nova_cell1:SELECT=4 {{(pid=104034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:25:10.198751 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG dbcounter [-] [104034] Writing DB stats nova_api:SELECT=8 {{(pid=104034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:25:10.256084 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-85595cfa-56e0-45f8-861b-65d252a3a085 admin admin] Calling method '>' {{(pid=104034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:25:10.257331 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 14 18:25:10.257331 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: warnings.warn(msg) Jun 14 18:25:10.258678 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG oslo_concurrency.lockutils [None req-85595cfa-56e0-45f8-861b-65d252a3a085 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:25:10.259130 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG oslo_concurrency.lockutils [None req-85595cfa-56e0-45f8-861b-65d252a3a085 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=104034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:25:10.259914 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG oslo_concurrency.lockutils [None req-85595cfa-56e0-45f8-861b-65d252a3a085 admin admin] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:25:10.260341 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG oslo_concurrency.lockutils [None req-85595cfa-56e0-45f8-861b-65d252a3a085 admin admin] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:25:10.287957 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO nova.api.openstack.requestlog [None req-85595cfa-56e0-45f8-861b-65d252a3a085 admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.094877 Jun 14 18:25:10.288551 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: [pid: 104034|app: 0|req: 37/74] 10.222.0.78 () {60 vars in 1193 bytes} [Tue Jun 14 18:25:10 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:25:11.180891 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: DEBUG nova.api.openstack.wsgi [None req-2674408f-ec9c-4295-9f5e-2ff066c642fa admin admin] Calling method '>' {{(pid=104033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:25:11.181942 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: INFO nova.api.openstack.requestlog [None req-2674408f-ec9c-4295-9f5e-2ff066c642fa admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jun 14 18:25:11.182332 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: [pid: 104033|app: 0|req: 38/75] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Jun 14 18:25:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:25:11.387440 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG nova.api.openstack.wsgi [None req-3ca58838-d85b-4d79-aea2-40a2b648083b admin admin] Calling method '>' {{(pid=104034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:25:11.388729 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 14 18:25:11.388729 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: warnings.warn(msg) Jun 14 18:25:11.389944 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG oslo_concurrency.lockutils [None req-3ca58838-d85b-4d79-aea2-40a2b648083b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:25:11.390383 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG oslo_concurrency.lockutils [None req-3ca58838-d85b-4d79-aea2-40a2b648083b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:25:11.391176 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG oslo_concurrency.lockutils [None req-3ca58838-d85b-4d79-aea2-40a2b648083b admin admin] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:25:11.391577 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: DEBUG oslo_concurrency.lockutils [None req-3ca58838-d85b-4d79-aea2-40a2b648083b admin admin] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:25:11.412710 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: INFO nova.api.openstack.requestlog [None req-3ca58838-d85b-4d79-aea2-40a2b648083b admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079918 Jun 14 18:25:11.413258 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: [pid: 104034|app: 0|req: 38/76] 10.222.0.78 () {60 vars in 1193 bytes} [Tue Jun 14 18:25:11 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:26:09.326465 dv-cinder-844563-2-iscsi devstack@n-api.service[104032]: Tue Jun 14 18:26:09 2022 - graceful shutdown triggered... Jun 14 18:26:09.325994 dv-cinder-844563-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 14 18:26:09.327469 dv-cinder-844563-2-iscsi devstack@n-api.service[104034]: Gracefully killing worker 2 (pid: 104034)... Jun 14 18:26:09.327823 dv-cinder-844563-2-iscsi devstack@n-api.service[104033]: Gracefully killing worker 1 (pid: 104033)... Jun 14 18:26:10.327134 dv-cinder-844563-2-iscsi devstack@n-api.service[104032]: worker 1 buried after 1 seconds Jun 14 18:26:10.327134 dv-cinder-844563-2-iscsi devstack@n-api.service[104032]: worker 2 buried after 1 seconds Jun 14 18:26:10.327134 dv-cinder-844563-2-iscsi devstack@n-api.service[104032]: goodbye to uWSGI. Jun 14 18:26:10.328721 dv-cinder-844563-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 14 18:26:10.329309 dv-cinder-844563-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 14 18:26:10.332431 dv-cinder-844563-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 14 18:26:10.346486 dv-cinder-844563-2-iscsi devstack@n-api.service[118608]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 14 18:26:10.348727 dv-cinder-844563-2-iscsi devstack@n-api.service[118608]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 14 18:26:10 2022] *** Jun 14 18:26:10.348727 dv-cinder-844563-2-iscsi devstack@n-api.service[118608]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 14 18:26:10.348727 dv-cinder-844563-2-iscsi devstack@n-api.service[118608]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 14 18:26:10.348727 dv-cinder-844563-2-iscsi devstack@n-api.service[118608]: nodename: dv-cinder-844563-2-iscsi Jun 14 18:26:10.348727 dv-cinder-844563-2-iscsi devstack@n-api.service[118608]: machine: x86_64 Jun 14 18:26:10.348727 dv-cinder-844563-2-iscsi devstack@n-api.service[118608]: clock source: unix Jun 14 18:26:10.348727 dv-cinder-844563-2-iscsi devstack@n-api.service[118608]: pcre jit disabled Jun 14 18:26:10.348727 dv-cinder-844563-2-iscsi devstack@n-api.service[118608]: detected number of CPU cores: 4 Jun 14 18:26:10.348727 dv-cinder-844563-2-iscsi devstack@n-api.service[118608]: current working directory: / Jun 14 18:26:10.348727 dv-cinder-844563-2-iscsi devstack@n-api.service[118608]: detected binary path: /usr/bin/uwsgi-core Jun 14 18:26:10.348727 dv-cinder-844563-2-iscsi devstack@n-api.service[118608]: your processes number limit is 47680 Jun 14 18:26:10.348727 dv-cinder-844563-2-iscsi devstack@n-api.service[118608]: your memory page size is 4096 bytes Jun 14 18:26:10.348727 dv-cinder-844563-2-iscsi devstack@n-api.service[118608]: detected max file descriptor number: 2048 Jun 14 18:26:10.348727 dv-cinder-844563-2-iscsi devstack@n-api.service[118608]: lock engine: pthread robust mutexes Jun 14 18:26:10.350565 dv-cinder-844563-2-iscsi devstack@n-api.service[118608]: thunder lock: enabled Jun 14 18:26:10.350565 dv-cinder-844563-2-iscsi devstack@n-api.service[118608]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 14 18:26:10.350565 dv-cinder-844563-2-iscsi devstack@n-api.service[118608]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 14 18:26:10.394836 dv-cinder-844563-2-iscsi devstack@n-api.service[118608]: Python main interpreter initialized at 0x55af2066b9c0 Jun 14 18:26:10.394836 dv-cinder-844563-2-iscsi devstack@n-api.service[118608]: python threads support enabled Jun 14 18:26:10.394836 dv-cinder-844563-2-iscsi devstack@n-api.service[118608]: your server socket listen backlog is limited to 100 connections Jun 14 18:26:10.394836 dv-cinder-844563-2-iscsi devstack@n-api.service[118608]: your mercy for graceful operations on workers is 90 seconds Jun 14 18:26:10.395242 dv-cinder-844563-2-iscsi devstack@n-api.service[118608]: mapped 403077 bytes (393 KB) for 2 cores Jun 14 18:26:10.395311 dv-cinder-844563-2-iscsi devstack@n-api.service[118608]: *** Operational MODE: preforking *** Jun 14 18:26:10.395575 dv-cinder-844563-2-iscsi devstack@n-api.service[118608]: *** uWSGI is running in multiple interpreter mode *** Jun 14 18:26:10.395575 dv-cinder-844563-2-iscsi devstack@n-api.service[118608]: spawned uWSGI master process (pid: 118608) Jun 14 18:26:10.395792 dv-cinder-844563-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 14 18:26:10.397283 dv-cinder-844563-2-iscsi devstack@n-api.service[118608]: spawned uWSGI worker 1 (pid: 118623, cores: 1) Jun 14 18:26:10.397283 dv-cinder-844563-2-iscsi devstack@n-api.service[118608]: spawned uWSGI worker 2 (pid: 118624, cores: 1) Jun 14 18:26:10.397283 dv-cinder-844563-2-iscsi devstack@n-api.service[118608]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 14 18:26:11.091417 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 14 18:26:11.098025 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 14 18:26:12.401746 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 14 18:26:12.401746 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: from cryptography.utils import int_from_bytes Jun 14 18:26:12.402902 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 14 18:26:12.402902 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: from cryptography.utils import int_from_bytes Jun 14 18:26:12.415459 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 14 18:26:12.415459 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: from cryptography.utils import int_from_bytes Jun 14 18:26:12.416034 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 14 18:26:12.416034 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: from cryptography.utils import int_from_bytes Jun 14 18:26:14.826162 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 14 18:26:14.826861 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 14 18:26:14.826861 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 14 18:26:14.827221 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 14 18:26:14.827472 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 14 18:26:14.827863 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.828197 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.828548 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.828841 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.829175 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.829524 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.834945 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.834945 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.834945 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.834945 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.834945 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.834945 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-2-iscsi {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.834945 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.834945 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.835918 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.835918 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.835918 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.835918 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.835918 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.835918 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.836366 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.836366 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.836366 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.836366 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.836366 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.836366 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.836366 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.836801 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.836801 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.837828 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.837828 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-2-iscsi {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.837828 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.838096 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.838398 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.838812 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.839141 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.839537 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.839856 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.840088 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.840383 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.841262 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.841602 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.841993 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.842349 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.842653 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.842976 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.843284 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.843616 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.843917 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.844210 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.844465 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.844792 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.845097 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.845536 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.845768 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.846025 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.846305 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.846599 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.846918 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.847224 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.847533 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.847839 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.848145 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.848468 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.848760 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.849067 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.852033 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.852033 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.852033 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.852033 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.852033 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.852033 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.852033 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.852033 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.853211 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.853211 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.853211 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.853211 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.853211 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.853958 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.853958 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.854249 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.854394 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.854701 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.855043 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.855446 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.855708 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.856090 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.857260 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.857901 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.858078 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.858269 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.858580 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.858884 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.859195 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.859544 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.859858 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.860166 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.860551 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.861070 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.861726 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.865840 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.865840 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.865840 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.865840 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.865840 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.865840 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.865840 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.865840 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.866497 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.866497 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.866497 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.866497 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.866497 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.866497 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.866497 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.866497 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.867062 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.867062 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.867460 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.867653 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.867971 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.868279 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.868585 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.868891 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.869207 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.869523 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.869829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.870131 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.870437 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.870735 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.871052 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.871378 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.871757 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.872243 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.872556 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.872881 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.873225 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.873584 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.873932 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.874350 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.874592 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.874931 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.875254 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.875569 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.875896 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.876220 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.876528 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.876841 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.877353 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.877632 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.877889 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.878144 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.878386 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.878707 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.879026 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.879374 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.880024 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.880024 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.880469 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.880731 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.880914 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.881697 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.881697 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.882082 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.882236 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.882663 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.882857 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.883160 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.883404 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.883747 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.884066 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.884390 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.884703 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.885083 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.885312 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.885676 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.885993 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.886334 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.886653 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.886977 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.887312 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.887652 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.887968 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.888281 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.888595 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.889191 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.889191 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.889538 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.889824 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.890129 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.890452 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.890778 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.891229 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.891480 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.891795 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.892137 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.892450 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.892767 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.893076 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.893391 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.893746 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.894053 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.894392 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.894697 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.895004 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.895327 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.895650 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.895972 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.896264 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.896840 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.897023 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.897171 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.897579 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.897826 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.898148 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.898464 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.898800 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.899133 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.899442 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.899763 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.900091 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.900409 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.900711 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.901021 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.901324 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.901660 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.901963 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.902274 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.902866 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.902866 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.903725 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.904317 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.904497 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 14 18:26:14.904985 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.905129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 14 18:26:14.905276 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.905276 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.905276 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.905765 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 14 18:26:14.905912 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.906079 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 14 18:26:14.906239 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.906401 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 14 18:26:14.906543 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.906693 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.906831 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.906971 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.907126 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.907266 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.907404 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.907565 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.907706 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.907844 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.907991 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.908139 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.908278 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.908424 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.908580 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.908737 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.908876 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.909311 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.909477 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.909477 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.909765 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.909765 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.910082 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.910322 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.910495 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-2-iscsi {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.910637 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.910872 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.911043 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.911184 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.911329 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.911468 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.911605 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.911756 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.911907 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.912048 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.912193 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.912339 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.912477 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.912631 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.912772 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.912921 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.913085 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.913225 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.913371 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.913553 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.913697 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.913844 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.913982 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.914313 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.914645 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.914801 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.914960 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.915177 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.915333 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.915474 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.915621 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.915760 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.915898 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.915898 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.916162 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.916308 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.916455 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.916594 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.916750 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-2-iscsi {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.917152 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.917376 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.917557 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.917721 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.917869 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.918010 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.918148 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.918286 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.918431 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.918607 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.919308 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.919663 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.919835 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.919988 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.920139 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.920318 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.920540 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.920698 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.920854 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.921080 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.921235 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.921389 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.921564 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.921706 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.921853 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.922015 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.922168 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.922316 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.922455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.922600 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.922745 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.922884 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.923030 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.923030 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.923309 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.923456 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.923608 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.923767 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.923920 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.923920 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.924219 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.924523 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.924902 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.925062 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.925213 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.925364 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.925562 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.925562 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.925853 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.925853 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.926153 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.926153 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.926425 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.926425 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.926425 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.926840 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.927454 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.927622 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.927767 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.927917 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.928066 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.928066 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.928066 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.928066 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.928614 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.928614 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.928935 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.929258 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.929771 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.930006 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.930336 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.930759 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.931017 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.931334 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.931686 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.932013 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.932332 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.932661 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.932991 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.933145 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.933295 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.933440 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.933636 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.933812 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.933961 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.934202 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.934361 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.934720 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.935211 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.935484 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.935484 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.935773 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.935912 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.936051 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.936051 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.936330 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.936477 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.937035 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.937193 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.937342 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.937528 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.937684 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.937832 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.937832 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.937832 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.938226 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.938372 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.938593 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.939412 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.939412 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.940049 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.940049 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.940349 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.940507 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.940769 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.941048 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.941364 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.941703 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.942018 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.942736 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.942889 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.943040 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.943180 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.943328 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.943473 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.943624 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.943776 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.943916 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.944060 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.944207 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.944355 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.944496 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.944496 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.944981 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.945375 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.945551 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.945705 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.945855 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.946015 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.946163 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.946311 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.946457 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.946604 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.946756 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.946896 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.947033 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.947171 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.947309 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.947448 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.947599 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.947749 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.947897 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.948043 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.948182 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.948328 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.948481 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.948620 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.948757 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.948896 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.948896 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.949173 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.949321 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.949485 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.949644 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.949784 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.950311 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.950311 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.950713 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.950880 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.951110 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.951110 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.951409 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.951665 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.951814 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 18:26:14.951961 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.952100 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.952256 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.952403 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.952556 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.952556 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.952829 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.952976 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.953122 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.953261 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.953407 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.953614 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.953756 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.953912 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.954079 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.954219 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.954358 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.954496 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.954641 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.954794 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.955131 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.955305 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.955766 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.955924 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.956079 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.956219 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.956366 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.956528 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.956695 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.956922 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.957075 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.957222 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.957369 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.957540 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.957694 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.957841 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.957996 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.958136 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.958283 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.958429 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.958578 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.958716 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.958863 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.959010 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.959156 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.959303 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.959450 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.959607 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.959754 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.959900 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.960066 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.960489 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.960657 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.960813 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.960962 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.961128 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.961365 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.961543 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.961803 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.961960 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.962103 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.962242 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.962380 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.962518 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.962664 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.962821 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.962970 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.963117 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.963258 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.963403 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.963551 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.963697 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.963843 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.963989 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.964137 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.964275 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.964422 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.964835 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.965377 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.966624 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.966803 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.966953 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.967112 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.967258 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.967412 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.967559 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.967711 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.967865 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.968020 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.968172 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.968326 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.968485 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.968485 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.968771 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.968917 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.968917 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.969199 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.969344 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.969521 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.969521 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.969819 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.969965 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.970117 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.970272 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.970827 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.971013 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.971172 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.971337 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.971571 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.971732 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.971988 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.972164 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.972316 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.972478 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.972625 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.972778 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.972949 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.973098 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.973252 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.973398 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.973585 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.973733 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.973890 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.974046 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.974192 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.974346 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.974498 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.974653 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.974812 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.974976 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.975128 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.975300 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.975616 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.975778 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.975934 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.976081 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.976234 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.976389 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.976553 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.976909 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.977074 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.977223 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.977379 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.977580 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.977739 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.977902 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.978057 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.978204 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.978350 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.978497 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.978642 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.978796 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.978949 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.979096 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.979248 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.979248 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.979545 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.979704 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.979850 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.979995 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.980147 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.980300 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.980453 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.980888 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.981082 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.981779 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.982040 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.982291 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.982458 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.982606 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.982759 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.982917 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.983065 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.983210 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.983365 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.983518 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.983671 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.983816 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.983961 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.984107 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.984354 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.984511 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.985258 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.985431 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.985789 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.985946 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.986101 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.986249 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.986249 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.986545 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.986691 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.987073 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.987235 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.987410 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.987558 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.987712 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.987867 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.988025 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.988453 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.988615 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.988763 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.988908 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.989094 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.989258 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.989538 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.989710 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.989859 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.990005 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.990158 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.990305 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.990451 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.990611 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.991061 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.991218 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.991379 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.991529 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.991529 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.991827 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.991999 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.992259 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.992504 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.992665 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.992827 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.992975 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.993122 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.993275 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.993422 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.993604 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.993768 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.993916 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.994072 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.994216 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.994369 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.994515 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.994675 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.994830 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.994977 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.995129 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.995284 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.995430 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.995430 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.995913 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.995913 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.996214 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.996214 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.996506 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.997617 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.997739 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.997847 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.997952 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.998050 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.998151 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.998248 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.998344 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.998435 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.998529 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.998529 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.998708 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.998795 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.998880 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.998970 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.999063 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.999155 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.999253 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.999339 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.999422 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.999505 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.999591 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.999673 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.999745 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.999823 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.999902 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:14.999981 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.000053 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.000131 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.000204 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.000281 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.000359 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.000431 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.000501 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.000579 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.000579 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.000713 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.000806 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.000806 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.000806 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.000806 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.000806 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.000806 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.000806 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.000806 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.001337 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.001337 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.001337 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.001337 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.001625 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.001709 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.002016 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.002224 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.002487 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.002734 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.002900 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.003058 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.003224 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.003379 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.003528 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.003691 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.003840 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.003987 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.004147 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.004302 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.004457 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.004604 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.004750 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.004904 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.005052 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.005429 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.005643 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.005643 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.006158 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.006329 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.006479 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.006625 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.006771 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.006904 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.007208 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.007630 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.007807 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.007900 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.007990 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.008063 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.008143 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.008330 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.008429 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.008510 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.008510 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.008649 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.008727 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.008806 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.008908 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.009000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.009135 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.009227 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.009478 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.009585 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.009799 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.009889 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.010116 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.010215 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.010433 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.010531 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.010746 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.010837 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.011298 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.011405 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.011496 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.011575 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.011734 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.011835 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.012002 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.012106 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.012354 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.012736 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.012937 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.013122 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.013335 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.013479 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.013788 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.013878 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.014124 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.014228 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.014441 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.014552 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.014763 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.014946 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.015129 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.015296 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.015451 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.015691 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.015835 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.015973 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.016125 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.016300 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.016412 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.016640 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.016786 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.016935 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.017036 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.017250 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.017349 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.017603 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.017800 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.017951 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.018099 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.018252 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.018427 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.018582 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.018743 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.018884 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.019034 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.019184 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.019324 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.019461 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.019664 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.019827 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.019966 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.020114 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.020252 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.020386 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.020526 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.020674 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.020812 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.020985 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.021087 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.021350 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.021504 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.025969 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.026252 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.026252 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.026430 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.026515 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.026607 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.026692 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.026782 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.026867 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.026945 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.027029 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.027125 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.027209 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.027299 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.027383 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.027472 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.027719 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.028637 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.028770 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.028895 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.028989 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.029072 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.029195 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.029332 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.030033 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.030480 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.030615 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.030747 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.030866 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.030985 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.031103 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.031221 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.031352 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.031680 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.031801 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.031919 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.032164 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.032284 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.032402 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.032629 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.032747 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.033356 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.033549 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.033549 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.033549 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.033549 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.033549 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.033549 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.033549 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.033549 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.034380 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.034380 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.034380 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.034380 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.034380 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.034888 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.035004 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.035112 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.035219 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.035350 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.035489 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.035578 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.035660 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.035749 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.035846 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.035930 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.036019 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.036102 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.036198 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.036289 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.036381 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.036505 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.036606 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.036691 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.036772 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.036772 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.036939 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.037024 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.037113 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.037223 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.038852 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.039575 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.039832 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.039930 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.040023 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.040023 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.040023 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.040023 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.040341 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.040341 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.040507 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.040591 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.040739 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.040831 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.040831 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.040831 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.041060 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.041149 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.041246 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.041330 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.041420 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.041676 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.041782 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.042261 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.042377 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.042618 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.042784 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.042939 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.043047 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.043265 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.043652 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.044259 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.044509 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.044610 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.044840 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.045146 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.045245 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.045506 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.045604 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.045841 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.047338 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.047786 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.047934 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.048030 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.048148 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.048295 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.048429 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.048521 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.048616 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.048616 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.048927 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.048927 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.049086 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.049166 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.049252 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.049364 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.049552 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.049700 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.049847 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.050008 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.050172 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.050339 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.050486 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.050653 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.050791 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.050975 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.051067 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.051162 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.051278 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.051446 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.051548 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.051634 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.051964 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.052083 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.052173 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.052258 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.052341 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.052424 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.052522 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.052617 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.052710 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.052803 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.052888 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.052971 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.053067 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.053153 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.053237 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.053396 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.053505 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.053694 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.053875 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.054032 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.054175 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.054328 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.054470 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.054624 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.054815 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.054959 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.055107 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.055282 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.055427 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.055580 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.055666 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.055899 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.056044 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.056219 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.056371 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.056520 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.056775 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.057056 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.057144 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.057215 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.058512 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.058695 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.058855 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.058965 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.059284 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.059393 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.059495 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.059615 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.059701 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.059783 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.059863 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.059948 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.059948 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.060106 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.060190 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.060271 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.060361 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.060443 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.060628 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.060761 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.060942 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.061085 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.061276 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.061408 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.064482 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.064721 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.064821 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.064914 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.065006 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.065099 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.065314 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.065410 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.065410 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.065935 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.066021 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.066108 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.066186 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.066265 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.066343 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.066421 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.066513 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.066609 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.066701 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.066792 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.066882 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.066966 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.067048 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.067142 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.067226 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.067308 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.067390 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.067769 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.067882 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.067977 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.068100 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.068206 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.068297 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.068369 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.068449 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.068533 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.068622 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.068705 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.068814 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.068896 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.068981 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.069060 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.069139 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.069229 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.069535 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.069632 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.069739 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.069825 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.069909 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.069990 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.070079 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.070176 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.070260 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.070342 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.070342 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.070492 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.070636 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.070758 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.070950 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.071048 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.071265 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.071456 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.071579 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.071777 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.071900 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.072142 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.072354 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.072461 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.072679 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.072783 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.072992 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.073091 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.073313 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.073404 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.073665 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.073759 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.074007 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.074153 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.075380 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.075497 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.075601 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.075688 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.075779 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.075863 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.075946 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.076035 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.076123 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.076272 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.076371 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.076546 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.076639 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.076882 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.076998 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.077202 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.077309 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.077558 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.077730 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.088757 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.089068 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.089157 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.089242 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.089242 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.089434 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.089632 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.089718 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.089805 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.089879 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.089958 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.090046 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.090150 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.090237 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.090329 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.090917 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.091072 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.091147 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.091249 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.091337 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.091422 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.091513 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.091608 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.091707 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.091793 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.091883 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.091976 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.092071 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.092158 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.092256 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.092359 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.092452 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.092545 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.092638 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.092731 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.092825 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.093114 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.093224 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.093322 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.093416 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.093548 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.093647 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.093737 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.093844 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.093931 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.094023 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.094293 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.094392 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.094478 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.094561 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.094644 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.094736 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.094832 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.094917 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.095001 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.095092 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.095177 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.095260 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.095357 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.095443 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.095527 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.095609 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.095699 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.095798 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.095885 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.095969 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.096052 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.096135 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.096225 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.096340 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.096437 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.096523 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.096596 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.096685 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.096685 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.096856 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.096949 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.097035 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.097118 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.097200 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.097291 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.097376 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.097476 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.097565 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.097652 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.097652 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.097816 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.097902 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.097986 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.098065 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.098765 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.098880 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.098979 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.098979 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.099132 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.099224 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.099308 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.099400 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.099500 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.099587 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.099659 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.099741 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.099823 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.099915 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.100008 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.100094 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.100176 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.100255 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.100333 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.100432 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.100514 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.100594 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.100665 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.100735 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.100812 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.100912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.101011 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.101105 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.101192 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.101283 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.101367 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.101489 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.101591 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.101680 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.101988 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.102075 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.102157 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.102157 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.102329 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.102415 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.102498 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.102590 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.103235 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.103332 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.103415 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.103495 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.103574 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.103650 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.103730 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.103830 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.103928 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.104014 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.104106 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.104198 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.104518 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.104611 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.104686 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.104764 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.104836 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.104938 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.105033 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.105117 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.105117 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.105269 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.105352 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.105443 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.105569 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.105667 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.105761 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.105853 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.105853 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.105853 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.105853 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.106180 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.106802 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.106904 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.107006 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.107099 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.107184 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.107184 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.107343 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.107428 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.107526 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.107526 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.107695 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.107788 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.107873 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.107956 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.108130 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.108226 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.108465 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.108580 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.108791 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.108887 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.109119 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.109216 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.109482 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.109581 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.109807 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.109951 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.110168 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.110279 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.110473 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.110633 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.110799 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.110930 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.111112 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.111212 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.111436 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.111537 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.111762 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.111853 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.112085 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.112179 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.112408 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.112508 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.112725 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.112818 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.113048 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.113142 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.113367 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.113512 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.119560 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.119836 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.119836 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.120014 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.120014 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.120184 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.120278 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.120352 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.120424 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.120524 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.120618 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.120717 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.120717 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.120874 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.120961 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.121033 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.121033 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.121208 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.121294 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.121365 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.121434 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.121541 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.121616 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.121696 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.121776 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.121855 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.121928 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.121998 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.122267 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.122364 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.122445 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.122526 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.122606 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.122678 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.122762 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.122855 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.122947 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 14 18:26:15.123034 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.123034 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.123034 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.123034 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.123034 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.123034 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.123034 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.123034 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.123605 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.123605 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.123605 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.123820 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.124067 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.124370 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.124692 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.125029 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.125381 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.125723 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.126052 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.126376 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.126839 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.127006 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.127325 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.127644 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.127956 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.128274 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.128586 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.128926 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.129238 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.129574 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.129895 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.130210 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.130525 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.130885 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.131180 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.131495 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.131820 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.132139 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.132449 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.132765 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.133085 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.133398 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.133740 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.134103 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.134444 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.134757 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.135073 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.135406 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.135721 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.136050 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.136369 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.136686 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.137070 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.138078 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.138974 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.139336 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.139673 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.140024 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.140368 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.140685 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.141003 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.141314 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.141682 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.142002 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.142333 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.142648 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.142969 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.143288 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.143602 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.143920 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.144240 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.144554 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.144872 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.145192 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.145527 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.145845 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.146168 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.146516 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.146844 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.147170 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.147510 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.147817 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.148135 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.148454 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.148774 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.149075 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.149405 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.149769 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.150089 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.150403 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.150840 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.151162 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.151489 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.151817 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.152141 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.152469 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.152796 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.153917 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.154318 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.154640 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.154980 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.155332 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.155673 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.156006 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.156321 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.156636 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.156945 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.157263 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.157702 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.158025 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.158339 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.158650 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.158971 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.159281 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.159592 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.159901 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.160213 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.160533 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.160823 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.161134 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.161489 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.161787 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.162097 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.162411 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.162728 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.163037 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.163348 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.163656 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.163963 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.164269 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.164615 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.164952 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.165273 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.165625 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.165940 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.166269 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.166594 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.167172 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.167501 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.167827 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.168143 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.168486 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.168857 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.169473 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.169888 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.170214 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.170537 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.170858 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.171198 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.171534 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.171849 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.172192 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.172519 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.172848 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.173173 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.173508 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.173854 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.174173 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.174492 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.174820 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.175140 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.175463 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.175789 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.176116 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.176453 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.176789 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.177111 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.177460 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.177806 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.178164 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.178485 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.178845 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.179189 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.179507 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.179826 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.180143 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 18:26:15.180391 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 14 18:26:15.183970 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO dbcounter [None req-78377d0f-a858-4100-a280-12cbdd866e2f None None] Registered counter for database nova_api Jun 14 18:26:15.204771 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_db.sqlalchemy.engines [None req-78377d0f-a858-4100-a280-12cbdd866e2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118624) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 18:26:15.211718 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writer thread running {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 18:26:15.246172 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO dbcounter [None req-33650bca-8e73-427f-8e2f-aa7bb3c2e479 None None] Registered counter for database nova_api Jun 14 18:26:15.267602 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_db.sqlalchemy.engines [None req-33650bca-8e73-427f-8e2f-aa7bb3c2e479 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118623) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 18:26:15.270798 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.context [None req-78377d0f-a858-4100-a280-12cbdd866e2f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fc5dd7f6-292c-4a57-9b07-38a1b91b5959(cell1) {{(pid=118624) load_cells /opt/stack/nova/nova/context.py:464}} Jun 14 18:26:15.274472 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writer thread running {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 18:26:15.275035 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-78377d0f-a858-4100-a280-12cbdd866e2f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:26:15.276612 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-78377d0f-a858-4100-a280-12cbdd866e2f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:26:15.277406 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-78377d0f-a858-4100-a280-12cbdd866e2f None None] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:26:15.280112 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-78377d0f-a858-4100-a280-12cbdd866e2f None None] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:26:15.282218 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO dbcounter [None req-78377d0f-a858-4100-a280-12cbdd866e2f None None] Registered counter for database nova_cell0 Jun 14 18:26:15.286240 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO dbcounter [None req-78377d0f-a858-4100-a280-12cbdd866e2f None None] Registered counter for database nova_cell1 Jun 14 18:26:15.295422 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_db.sqlalchemy.engines [None req-78377d0f-a858-4100-a280-12cbdd866e2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118624) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 18:26:15.297293 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_db.sqlalchemy.engines [None req-78377d0f-a858-4100-a280-12cbdd866e2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118624) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 18:26:15.302934 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writer thread running {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 18:26:15.339994 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.context [None req-33650bca-8e73-427f-8e2f-aa7bb3c2e479 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fc5dd7f6-292c-4a57-9b07-38a1b91b5959(cell1) {{(pid=118623) load_cells /opt/stack/nova/nova/context.py:464}} Jun 14 18:26:15.345903 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-33650bca-8e73-427f-8e2f-aa7bb3c2e479 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:26:15.347498 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-33650bca-8e73-427f-8e2f-aa7bb3c2e479 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:26:15.348301 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-33650bca-8e73-427f-8e2f-aa7bb3c2e479 None None] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:26:15.350329 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-33650bca-8e73-427f-8e2f-aa7bb3c2e479 None None] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:26:15.352389 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO dbcounter [None req-33650bca-8e73-427f-8e2f-aa7bb3c2e479 None None] Registered counter for database nova_cell0 Jun 14 18:26:15.356512 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO dbcounter [None req-33650bca-8e73-427f-8e2f-aa7bb3c2e479 None None] Registered counter for database nova_cell1 Jun 14 18:26:15.364793 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_db.sqlalchemy.engines [None req-33650bca-8e73-427f-8e2f-aa7bb3c2e479 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118623) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 18:26:15.365872 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_db.sqlalchemy.engines [None req-33650bca-8e73-427f-8e2f-aa7bb3c2e479 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118623) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 18:26:15.373585 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writer thread running {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 18:26:15.373923 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writer thread running {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 18:26:15.445187 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writer thread running {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 18:26:15.456427 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO dbcounter [None req-78377d0f-a858-4100-a280-12cbdd866e2f None None] Registered counter for database nova_cell0 Jun 14 18:26:15.463270 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_db.sqlalchemy.engines [None req-78377d0f-a858-4100-a280-12cbdd866e2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118624) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 18:26:15.468990 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writer thread running {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 18:26:15.523383 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO dbcounter [None req-33650bca-8e73-427f-8e2f-aa7bb3c2e479 None None] Registered counter for database nova_cell0 Jun 14 18:26:15.531138 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_db.sqlalchemy.engines [None req-33650bca-8e73-427f-8e2f-aa7bb3c2e479 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118623) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 18:26:15.536432 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writer thread running {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 18:26:15.792832 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: WARNING keystonemiddleware.auth_token [None req-78377d0f-a858-4100-a280-12cbdd866e2f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 14 18:26:15.800673 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: WARNING keystonemiddleware.auth_token [None req-78377d0f-a858-4100-a280-12cbdd866e2f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 14 18:26:15.873613 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: WARNING keystonemiddleware.auth_token [None req-33650bca-8e73-427f-8e2f-aa7bb3c2e479 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 14 18:26:15.881190 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: WARNING keystonemiddleware.auth_token [None req-33650bca-8e73-427f-8e2f-aa7bb3c2e479 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 14 18:26:16.146279 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: WARNING keystonemiddleware.auth_token [None req-78377d0f-a858-4100-a280-12cbdd866e2f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 14 18:26:16.152378 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: WARNING keystonemiddleware.auth_token [None req-78377d0f-a858-4100-a280-12cbdd866e2f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 14 18:26:16.158004 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55af2066b9c0 pid: 118624 (default app) Jun 14 18:26:16.240473 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: WARNING keystonemiddleware.auth_token [None req-33650bca-8e73-427f-8e2f-aa7bb3c2e479 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 14 18:26:16.246742 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: WARNING keystonemiddleware.auth_token [None req-33650bca-8e73-427f-8e2f-aa7bb3c2e479 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 14 18:26:16.253279 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55af2066b9c0 pid: 118623 (default app) Jun 14 18:26:59.493926 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_api:SELECT=3 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:26:59.495483 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_api:SELECT=3 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:26:59.497776 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell0:SELECT=3 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:26:59.498916 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell1:SELECT=3 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:26:59.499240 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell0:SELECT=3 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:26:59.501160 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell0:SELECT=3 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:26:59.501534 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell1:SELECT=3 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:26:59.505173 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell0:SELECT=3 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:27:00.672139 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-a0958e80-c77a-41ce-b166-6352b46a0108 tempest-VolumesGetTestJSON-1542263720 tempest-VolumesGetTestJSON-1542263720-project] Action: 'create', calling method: .version_select at 0x7efe72b5f940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-595107333", "metadata": {"Type": "work"}}} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:27:00.861336 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-7fbbe63f-cf00-4ecc-a459-5e926d4e3589 tempest-VolumesNegativeTest-1654288863 tempest-VolumesNegativeTest-1654288863-project] Action: 'create', calling method: .version_select at 0x7efe72b53820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1955182977", "metadata": {"Type": "work"}}} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:27:00.883520 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-7fbbe63f-cf00-4ecc-a459-5e926d4e3589 tempest-VolumesNegativeTest-1654288863 tempest-VolumesNegativeTest-1654288863-project] Request method failure captured: Jun 14 18:27:00.883520 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 14 18:27:00.883520 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept: application/json Jun 14 18:27:00.883520 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept-Encoding: identity Jun 14 18:27:00.883520 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Connection: close Jun 14 18:27:00.883520 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Length: 122 Jun 14 18:27:00.883520 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Type: application/json Jun 14 18:27:00.883520 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Host: 10.222.0.78 Jun 14 18:27:00.883520 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Openstack-System-Scope: None Jun 14 18:27:00.883520 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: User-Agent: python-urllib3/1.26.9 Jun 14 18:27:00.883520 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Auth-Token: gAAAAABiqNLzupgy5hd8quS8Wx9lTSm5AKsd8HPQbh9wC74M5l66PhHjaA-2MlEBABkApNZ9iqaPqfs5DD1kkrhleIV1Wc-IC-JXp6E-etJnoKtDQJjsEzzm-7oZ6AyZkSBZHdlGI0u-O5l3yVOjqTV6Esl3tgyhWjh8y7SqLrB3vmFbumqjHvg Jun 14 18:27:00.883520 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Id: None Jun 14 18:27:00.883520 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Name: None Jun 14 18:27:00.883520 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Identity-Status: Confirmed Jun 14 18:27:00.883520 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Is-Admin-Project: True Jun 14 18:27:00.883520 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Id: default Jun 14 18:27:00.883520 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Name: Default Jun 14 18:27:00.883520 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Id: daf8bccbe7044c1ab743fcfb238b3ffe Jun 14 18:27:00.883520 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Name: tempest-VolumesNegativeTest-1654288863 Jun 14 18:27:00.883520 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Role: reader,member Jun 14 18:27:00.883520 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Roles: reader,member Jun 14 18:27:00.885192 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_daf8bccbe7044c1ab743fcfb238b3ffe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/daf8bccbe7044c1ab743fcfb238b3ffe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/daf8bccbe7044c1ab743fcfb238b3ffe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/daf8bccbe7044c1ab743fcfb238b3ffe"}]}] Jun 14 18:27:00.885192 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant: tempest-VolumesNegativeTest-1654288863 Jun 14 18:27:00.885192 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Id: daf8bccbe7044c1ab743fcfb238b3ffe Jun 14 18:27:00.885192 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Name: tempest-VolumesNegativeTest-1654288863 Jun 14 18:27:00.885192 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User: tempest-VolumesNegativeTest-1654288863-project Jun 14 18:27:00.885192 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Id: default Jun 14 18:27:00.885192 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Name: Default Jun 14 18:27:00.885192 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Id: 9e01750e0fa54f36822f365d7f1253fe Jun 14 18:27:00.885192 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Name: tempest-VolumesNegativeTest-1654288863-project Jun 14 18:27:00.885192 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Jun 14 18:27:00.885192 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1955182977", "metadata": {"Type": "work"}}} Jun 14 18:27:00.885192 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: method: Jun 14 18:27:00.885192 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 14 18:27:00.886417 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1955182977', 'metadata': {'Type': 'work'}}}} Jun 14 18:27:00.886417 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:27:00.886417 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:27:00.886417 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 14 18:27:00.886417 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 14 18:27:00.886417 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 14 18:27:00.886417 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise error Jun 14 18:27:00.886417 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 14 18:27:00.886417 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:27:00.886417 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 14 18:27:00.886417 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 14 18:27:00.886417 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:27:00.886417 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 14 18:27:00.886417 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi '#$%' Jun 14 18:27:00.886417 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:27:00.886417 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:27:00.886417 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:27:00.886417 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:27:00.886417 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:27:00.886417 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:27:00.886417 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:27:00.886417 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:27:00.888675 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 14 18:27:00.888675 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 14 18:27:00.888675 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:27:00.888675 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:27:00.888675 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 14 18:27:00.888675 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 14 18:27:00.888675 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 14 18:27:00.888675 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 14 18:27:00.888675 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 14 18:27:00.888675 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 14 18:27:00.888675 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 14 18:27:00.888675 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:27:00.888675 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:27:00.888675 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:27:00.888675 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:27:00.888675 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:27:00.888675 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:27:00.888675 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 14 18:27:00.888675 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 14 18:27:00.889888 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 14 18:27:00.889888 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:27:00.891795 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-7fbbe63f-cf00-4ecc-a459-5e926d4e3589 tempest-VolumesNegativeTest-1654288863 tempest-VolumesNegativeTest-1654288863-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:27:00.893207 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-7fbbe63f-cf00-4ecc-a459-5e926d4e3589 tempest-VolumesNegativeTest-1654288863 tempest-VolumesNegativeTest-1654288863-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.421905 Jun 14 18:27:00.894102 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 1/1] 10.222.0.78 () {60 vars in 1155 bytes} [Tue Jun 14 18:26:59 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1425 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 14 18:27:01.144637 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-1d4433d7-d5b1-4f6e-9880-727048e5037a tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-310483514", "imageRef": "e2555120-8576-4128-944f-40805aa95a9b", "flavorRef": "452", "networks": [{"uuid": "6ab11bf3-ae17-49e6-a188-4b68af6636e2"}]}} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:27:01.595802 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.network.neutron [None req-1d4433d7-d5b1-4f6e-9880-727048e5037a tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] validate_networks() for [('6ab11bf3-ae17-49e6-a188-4b68af6636e2', None, None, None, None, None)] {{(pid=118623) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 18:27:02.653366 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-1d4433d7-d5b1-4f6e-9880-727048e5037a tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Flavor limits 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 18:27:02.654483 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-1d4433d7-d5b1-4f6e-9880-727048e5037a tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Image limits 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 18:27:02.655033 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-1d4433d7-d5b1-4f6e-9880-727048e5037a tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Flavor pref 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 18:27:02.655705 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-1d4433d7-d5b1-4f6e-9880-727048e5037a tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Image pref 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 18:27:02.656438 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-1d4433d7-d5b1-4f6e-9880-727048e5037a tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 18:27:02.673861 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1d4433d7-d5b1-4f6e-9880-727048e5037a tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:02.674447 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1d4433d7-d5b1-4f6e-9880-727048e5037a tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:02.675441 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1d4433d7-d5b1-4f6e-9880-727048e5037a tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:02.675884 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1d4433d7-d5b1-4f6e-9880-727048e5037a tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:02.771893 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.quota [None req-1d4433d7-d5b1-4f6e-9880-727048e5037a tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Getting quotas for project 3ea8b1ec08d6485ab1ac360549789d2b. Resources: {'instances', 'cores', 'ram'} {{(pid=118623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:27:02.789296 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.quota [None req-1d4433d7-d5b1-4f6e-9880-727048e5037a tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Getting quotas for user 419d0cc6ca7e426cb28257b32037901d and project 3ea8b1ec08d6485ab1ac360549789d2b. Resources: {'instances', 'cores', 'ram'} {{(pid=118623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:27:02.816201 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-1d4433d7-d5b1-4f6e-9880-727048e5037a tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Going to run 1 instances... {{(pid=118623) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 18:27:02.838343 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-1d4433d7-d5b1-4f6e-9880-727048e5037a tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] [instance: 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e2555120-8576-4128-944f-40805aa95a9b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118623) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 18:27:02.900246 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-a0958e80-c77a-41ce-b166-6352b46a0108 tempest-VolumesGetTestJSON-1542263720 tempest-VolumesGetTestJSON-1542263720-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.441141 Jun 14 18:27:02.913507 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 1/2] 10.222.0.78 () {60 vars in 1155 bytes} [Tue Jun 14 18:26:59 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3456 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 14 18:27:02.923192 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-1209f3c7-1b88-49f9-a868-803e29f7a438 tempest-VolumesNegativeTest-1654288863 tempest-VolumesNegativeTest-1654288863-project] Action: 'create', calling method: .version_select at 0x7efe72a25550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1473972578", "metadata": {"Type": "work"}}} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:27:02.967090 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-1209f3c7-1b88-49f9-a868-803e29f7a438 tempest-VolumesNegativeTest-1654288863 tempest-VolumesNegativeTest-1654288863-project] Request method failure captured: Jun 14 18:27:02.967090 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 14 18:27:02.967090 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept: application/json Jun 14 18:27:02.967090 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept-Encoding: identity Jun 14 18:27:02.967090 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Connection: close Jun 14 18:27:02.967090 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Length: 120 Jun 14 18:27:02.967090 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Type: application/json Jun 14 18:27:02.967090 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Host: 10.222.0.78 Jun 14 18:27:02.967090 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Openstack-System-Scope: None Jun 14 18:27:02.967090 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: User-Agent: python-urllib3/1.26.9 Jun 14 18:27:02.967090 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Auth-Token: gAAAAABiqNLzupgy5hd8quS8Wx9lTSm5AKsd8HPQbh9wC74M5l66PhHjaA-2MlEBABkApNZ9iqaPqfs5DD1kkrhleIV1Wc-IC-JXp6E-etJnoKtDQJjsEzzm-7oZ6AyZkSBZHdlGI0u-O5l3yVOjqTV6Esl3tgyhWjh8y7SqLrB3vmFbumqjHvg Jun 14 18:27:02.967090 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Id: None Jun 14 18:27:02.967090 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Name: None Jun 14 18:27:02.967090 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Identity-Status: Confirmed Jun 14 18:27:02.967090 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Is-Admin-Project: True Jun 14 18:27:02.967090 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Id: default Jun 14 18:27:02.967090 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Name: Default Jun 14 18:27:02.967090 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Id: daf8bccbe7044c1ab743fcfb238b3ffe Jun 14 18:27:02.967090 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Name: tempest-VolumesNegativeTest-1654288863 Jun 14 18:27:02.967090 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Role: reader,member Jun 14 18:27:02.967090 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Roles: reader,member Jun 14 18:27:02.968147 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_daf8bccbe7044c1ab743fcfb238b3ffe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/daf8bccbe7044c1ab743fcfb238b3ffe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/daf8bccbe7044c1ab743fcfb238b3ffe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/daf8bccbe7044c1ab743fcfb238b3ffe"}]}] Jun 14 18:27:02.968147 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant: tempest-VolumesNegativeTest-1654288863 Jun 14 18:27:02.968147 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Id: daf8bccbe7044c1ab743fcfb238b3ffe Jun 14 18:27:02.968147 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Name: tempest-VolumesNegativeTest-1654288863 Jun 14 18:27:02.968147 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User: tempest-VolumesNegativeTest-1654288863-project Jun 14 18:27:02.968147 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Id: default Jun 14 18:27:02.968147 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Name: Default Jun 14 18:27:02.968147 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Id: 9e01750e0fa54f36822f365d7f1253fe Jun 14 18:27:02.968147 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Name: tempest-VolumesNegativeTest-1654288863-project Jun 14 18:27:02.968147 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Jun 14 18:27:02.968147 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1473972578", "metadata": {"Type": "work"}}} Jun 14 18:27:02.968147 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: method: Jun 14 18:27:02.968147 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 14 18:27:02.968723 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1473972578', 'metadata': {'Type': 'work'}}}} Jun 14 18:27:02.968723 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:27:02.968723 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:27:02.968723 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 14 18:27:02.968723 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 14 18:27:02.968723 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 14 18:27:02.968723 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise error Jun 14 18:27:02.968723 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 14 18:27:02.968723 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:27:02.968723 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 14 18:27:02.968723 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 14 18:27:02.968723 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:27:02.968723 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 14 18:27:02.968723 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi '0' Jun 14 18:27:02.968723 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:27:02.968723 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:27:02.968723 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:27:02.968723 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:27:02.968723 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:27:02.968723 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:27:02.968723 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:27:02.968723 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:27:02.969768 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 14 18:27:02.969768 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 14 18:27:02.969768 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:27:02.969768 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:27:02.969768 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 14 18:27:02.969768 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 14 18:27:02.969768 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 14 18:27:02.969768 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 14 18:27:02.969768 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 14 18:27:02.969768 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 14 18:27:02.969768 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 14 18:27:02.969768 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:27:02.969768 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:27:02.969768 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:27:02.969768 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:27:02.969768 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:27:02.969768 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:27:02.969768 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 14 18:27:02.969768 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 14 18:27:02.970577 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 14 18:27:02.970577 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:27:02.970577 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-1209f3c7-1b88-49f9-a868-803e29f7a438 tempest-VolumesNegativeTest-1654288863 tempest-VolumesNegativeTest-1654288863-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:27:02.970577 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-1209f3c7-1b88-49f9-a868-803e29f7a438 tempest-VolumesNegativeTest-1654288863 tempest-VolumesNegativeTest-1654288863-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.054538 Jun 14 18:27:02.971019 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 2/3] 10.222.0.78 () {60 vars in 1155 bytes} [Tue Jun 14 18:27:02 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 14 18:27:02.980074 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-b92d60d4-95cb-4d86-b4e4-b3396f4440a8 tempest-VolumesGetTestJSON-1542263720 tempest-VolumesGetTestJSON-1542263720-project] Calling method '.version_select at 0x7efe73406af0>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:03.079791 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-b92d60d4-95cb-4d86-b4e4-b3396f4440a8 tempest-VolumesGetTestJSON-1542263720 tempest-VolumesGetTestJSON-1542263720-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/809ced5d-9019-477a-81bd-1b926e142d96" status: 200 len: 352 microversion: 2.1 time: 0.106598 Jun 14 18:27:03.081318 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 3/4] 10.222.0.78 () {58 vars in 1244 bytes} [Tue Jun 14 18:27:02 2022] GET /compute/v2.1/os-volumes/809ced5d-9019-477a-81bd-1b926e142d96 => generated 352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:27:03.093318 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-61bd109d-839b-4d80-8524-4b1e7b47b56e tempest-VolumesNegativeTest-1654288863 tempest-VolumesNegativeTest-1654288863-project] Action: 'create', calling method: .version_select at 0x7efe72b87280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-64324030", "metadata": {"Type": "work"}}} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:27:03.097958 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-61bd109d-839b-4d80-8524-4b1e7b47b56e tempest-VolumesNegativeTest-1654288863 tempest-VolumesNegativeTest-1654288863-project] Request method failure captured: Jun 14 18:27:03.097958 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 14 18:27:03.097958 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept: application/json Jun 14 18:27:03.097958 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept-Encoding: identity Jun 14 18:27:03.097958 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Connection: close Jun 14 18:27:03.097958 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Length: 117 Jun 14 18:27:03.097958 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Type: application/json Jun 14 18:27:03.097958 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Host: 10.222.0.78 Jun 14 18:27:03.097958 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Openstack-System-Scope: None Jun 14 18:27:03.097958 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: User-Agent: python-urllib3/1.26.9 Jun 14 18:27:03.097958 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Auth-Token: gAAAAABiqNLzupgy5hd8quS8Wx9lTSm5AKsd8HPQbh9wC74M5l66PhHjaA-2MlEBABkApNZ9iqaPqfs5DD1kkrhleIV1Wc-IC-JXp6E-etJnoKtDQJjsEzzm-7oZ6AyZkSBZHdlGI0u-O5l3yVOjqTV6Esl3tgyhWjh8y7SqLrB3vmFbumqjHvg Jun 14 18:27:03.097958 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Id: None Jun 14 18:27:03.097958 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Name: None Jun 14 18:27:03.097958 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Identity-Status: Confirmed Jun 14 18:27:03.097958 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Is-Admin-Project: True Jun 14 18:27:03.097958 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Id: default Jun 14 18:27:03.097958 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Name: Default Jun 14 18:27:03.097958 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Id: daf8bccbe7044c1ab743fcfb238b3ffe Jun 14 18:27:03.097958 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Name: tempest-VolumesNegativeTest-1654288863 Jun 14 18:27:03.097958 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Role: reader,member Jun 14 18:27:03.097958 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Roles: reader,member Jun 14 18:27:03.098985 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_daf8bccbe7044c1ab743fcfb238b3ffe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/daf8bccbe7044c1ab743fcfb238b3ffe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/daf8bccbe7044c1ab743fcfb238b3ffe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/daf8bccbe7044c1ab743fcfb238b3ffe"}]}] Jun 14 18:27:03.098985 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant: tempest-VolumesNegativeTest-1654288863 Jun 14 18:27:03.098985 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Id: daf8bccbe7044c1ab743fcfb238b3ffe Jun 14 18:27:03.098985 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Name: tempest-VolumesNegativeTest-1654288863 Jun 14 18:27:03.098985 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User: tempest-VolumesNegativeTest-1654288863-project Jun 14 18:27:03.098985 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Id: default Jun 14 18:27:03.098985 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Name: Default Jun 14 18:27:03.098985 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Id: 9e01750e0fa54f36822f365d7f1253fe Jun 14 18:27:03.098985 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Name: tempest-VolumesNegativeTest-1654288863-project Jun 14 18:27:03.098985 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Jun 14 18:27:03.098985 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-64324030", "metadata": {"Type": "work"}}} Jun 14 18:27:03.098985 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: method: Jun 14 18:27:03.098985 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 14 18:27:03.099555 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-64324030', 'metadata': {'Type': 'work'}}}} Jun 14 18:27:03.099555 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:27:03.099555 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:27:03.099555 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 14 18:27:03.099555 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 14 18:27:03.099555 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 14 18:27:03.099555 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise error Jun 14 18:27:03.099555 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 14 18:27:03.099555 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:27:03.099555 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 14 18:27:03.099555 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 14 18:27:03.099555 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:27:03.099555 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 14 18:27:03.099555 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi '' Jun 14 18:27:03.099555 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:27:03.099555 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:27:03.099555 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:27:03.099555 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:27:03.099555 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:27:03.099555 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:27:03.099555 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:27:03.099555 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:27:03.100455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 14 18:27:03.100455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 14 18:27:03.100455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:27:03.100455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:27:03.100455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 14 18:27:03.100455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 14 18:27:03.100455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 14 18:27:03.100455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 14 18:27:03.100455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 14 18:27:03.100455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 14 18:27:03.100455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 14 18:27:03.100455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:27:03.100455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:27:03.100455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:27:03.100455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:27:03.100455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:27:03.100455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:27:03.100455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 14 18:27:03.100455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 14 18:27:03.101251 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 14 18:27:03.101251 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:27:03.105188 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-61bd109d-839b-4d80-8524-4b1e7b47b56e tempest-VolumesNegativeTest-1654288863 tempest-VolumesNegativeTest-1654288863-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:27:03.109480 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-61bd109d-839b-4d80-8524-4b1e7b47b56e tempest-VolumesNegativeTest-1654288863 tempest-VolumesNegativeTest-1654288863-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.026402 Jun 14 18:27:03.110150 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 4/5] 10.222.0.78 () {60 vars in 1155 bytes} [Tue Jun 14 18:27:03 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 14 18:27:03.125216 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-5bd68981-ae8c-4734-a3d0-186520d05272 tempest-VolumesNegativeTest-1654288863 tempest-VolumesNegativeTest-1654288863-project] Calling method '.version_select at 0x7efe729d3f70>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:03.185022 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-1d4433d7-d5b1-4f6e-9880-727048e5037a tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.287927 Jun 14 18:27:03.191877 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 2/6] 10.222.0.78 () {60 vars in 1146 bytes} [Tue Jun 14 18:27:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2296 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 18:27:03.205388 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-65e789d7-e1e7-4f42-8192-66954bf4a370 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:03.207257 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-65e789d7-e1e7-4f42-8192-66954bf4a370 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] [instance: 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:03.268850 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.wsgi [None req-5bd68981-ae8c-4734-a3d0-186520d05272 tempest-VolumesNegativeTest-1654288863 tempest-VolumesNegativeTest-1654288863-project] HTTP exception thrown: Volume tempest-invalid-1988059566 could not be found. Jun 14 18:27:03.273701 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-5bd68981-ae8c-4734-a3d0-186520d05272 tempest-VolumesNegativeTest-1654288863 tempest-VolumesNegativeTest-1654288863-project] Request method failure captured: Jun 14 18:27:03.273701 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1988059566 HTTP/1.1 Jun 14 18:27:03.273701 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept: application/json Jun 14 18:27:03.273701 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept-Encoding: identity Jun 14 18:27:03.273701 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Connection: close Jun 14 18:27:03.273701 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Length: 0 Jun 14 18:27:03.273701 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Type: application/json Jun 14 18:27:03.273701 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Host: 10.222.0.78 Jun 14 18:27:03.273701 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Openstack-System-Scope: None Jun 14 18:27:03.273701 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: User-Agent: python-urllib3/1.26.9 Jun 14 18:27:03.273701 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Auth-Token: gAAAAABiqNLzupgy5hd8quS8Wx9lTSm5AKsd8HPQbh9wC74M5l66PhHjaA-2MlEBABkApNZ9iqaPqfs5DD1kkrhleIV1Wc-IC-JXp6E-etJnoKtDQJjsEzzm-7oZ6AyZkSBZHdlGI0u-O5l3yVOjqTV6Esl3tgyhWjh8y7SqLrB3vmFbumqjHvg Jun 14 18:27:03.273701 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Id: None Jun 14 18:27:03.273701 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Name: None Jun 14 18:27:03.273701 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Identity-Status: Confirmed Jun 14 18:27:03.273701 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Is-Admin-Project: True Jun 14 18:27:03.273701 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Id: default Jun 14 18:27:03.273701 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Name: Default Jun 14 18:27:03.273701 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Id: daf8bccbe7044c1ab743fcfb238b3ffe Jun 14 18:27:03.273701 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Name: tempest-VolumesNegativeTest-1654288863 Jun 14 18:27:03.273701 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Role: reader,member Jun 14 18:27:03.273701 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Roles: reader,member Jun 14 18:27:03.283074 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_daf8bccbe7044c1ab743fcfb238b3ffe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/daf8bccbe7044c1ab743fcfb238b3ffe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/daf8bccbe7044c1ab743fcfb238b3ffe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/daf8bccbe7044c1ab743fcfb238b3ffe"}]}] Jun 14 18:27:03.283074 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant: tempest-VolumesNegativeTest-1654288863 Jun 14 18:27:03.283074 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Id: daf8bccbe7044c1ab743fcfb238b3ffe Jun 14 18:27:03.283074 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Name: tempest-VolumesNegativeTest-1654288863 Jun 14 18:27:03.283074 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User: tempest-VolumesNegativeTest-1654288863-project Jun 14 18:27:03.283074 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Id: default Jun 14 18:27:03.283074 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Name: Default Jun 14 18:27:03.283074 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Id: 9e01750e0fa54f36822f365d7f1253fe Jun 14 18:27:03.283074 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Name: tempest-VolumesNegativeTest-1654288863-project Jun 14 18:27:03.283074 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: method: Jun 14 18:27:03.283074 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: exception: Volume tempest-invalid-1988059566 could not be found. Jun 14 18:27:03.283074 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: action_args: {'id': 'tempest-invalid-1988059566'} Jun 14 18:27:03.283074 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:27:03.284000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:27:03.284000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 14 18:27:03.284000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 14 18:27:03.284000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 14 18:27:03.284000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 14 18:27:03.284000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 14 18:27:03.284000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 14 18:27:03.284000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 14 18:27:03.284000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 14 18:27:03.284000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 14 18:27:03.284000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 14 18:27:03.284000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 18:27:03.284000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 18:27:03.284000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 18:27:03.284000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 18:27:03.284000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1988059566 could not be found. (HTTP 404) (Request-ID: req-537737b1-3ad8-4cb4-934d-9a2493fd1f91) Jun 14 18:27:03.284000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:27:03.284000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:27:03.284000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:27:03.285368 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:27:03.285368 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 14 18:27:03.285368 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 14 18:27:03.285368 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 14 18:27:03.285368 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 14 18:27:03.285368 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 14 18:27:03.285368 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 14 18:27:03.285368 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 14 18:27:03.285368 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 14 18:27:03.285368 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 14 18:27:03.285368 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 14 18:27:03.285368 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 14 18:27:03.285368 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 14 18:27:03.285368 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 14 18:27:03.285368 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 14 18:27:03.285368 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 14 18:27:03.285368 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 14 18:27:03.285368 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 14 18:27:03.285368 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 14 18:27:03.286455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 18:27:03.286455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 18:27:03.286455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 18:27:03.286455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 18:27:03.286455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1988059566 could not be found. Jun 14 18:27:03.286455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:27:03.286455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:27:03.286455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:27:03.286455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:27:03.286455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:27:03.286455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:27:03.286455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:27:03.286455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:27:03.286455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 14 18:27:03.286455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 14 18:27:03.286455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:27:03.286455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:27:03.286455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 14 18:27:03.286455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:27:03.286455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1988059566 could not be found. Jun 14 18:27:03.287606 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:27:03.287606 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:27:03.287606 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:27:03.287606 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:27:03.287606 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:27:03.287606 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:27:03.287606 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:27:03.287606 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:27:03.287606 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1988059566 could not be found. Jun 14 18:27:03.287606 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:27:03.287606 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-5bd68981-ae8c-4734-a3d0-186520d05272 tempest-VolumesNegativeTest-1654288863 tempest-VolumesNegativeTest-1654288863-project] Returning 404 to user: Volume tempest-invalid-1988059566 could not be found. {{(pid=118624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:27:03.287606 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-5bd68981-ae8c-4734-a3d0-186520d05272 tempest-VolumesNegativeTest-1654288863 tempest-VolumesNegativeTest-1654288863-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1988059566" status: 404 len: 99 microversion: 2.1 time: 0.154689 Jun 14 18:27:03.287606 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 5/7] 10.222.0.78 () {58 vars in 1217 bytes} [Tue Jun 14 18:27:03 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1988059566 => generated 99 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 14 18:27:03.288348 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-daf4a6b5-853b-4fe2-8d6c-e85f037edc19 tempest-VolumesNegativeTest-1654288863 tempest-VolumesNegativeTest-1654288863-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003870 Jun 14 18:27:03.289509 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 6/8] 10.222.0.78 () {58 vars in 1139 bytes} [Tue Jun 14 18:27:03 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 14 18:27:03.299233 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-0cd7b044-d242-4a42-aad2-bcff3effb547 tempest-VolumesNegativeTest-1654288863 tempest-VolumesNegativeTest-1654288863-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004231 Jun 14 18:27:03.300547 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 7/9] 10.222.0.78 () {58 vars in 1136 bytes} [Tue Jun 14 18:27:03 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 14 18:27:03.309914 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-ead292ef-32f2-4f74-a086-04c4fe0118df tempest-VolumesNegativeTest-1654288863 tempest-VolumesNegativeTest-1654288863-project] Calling method '.version_select at 0x7efe729ea670>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:03.458996 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-65e789d7-e1e7-4f42-8192-66954bf4a370 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419d0cc6ca7e426cb28257b32037901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea8b1ec08d6485ab1ac360549789d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:03.479026 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-65e789d7-e1e7-4f42-8192-66954bf4a370 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] 10.222.0.78 "GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd" status: 200 len: 1214 microversion: 2.1 time: 0.280355 Jun 14 18:27:03.493671 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 3/10] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:03 2022] GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd => generated 1214 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:03.626634 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.wsgi [None req-ead292ef-32f2-4f74-a086-04c4fe0118df tempest-VolumesNegativeTest-1654288863 tempest-VolumesNegativeTest-1654288863-project] HTTP exception thrown: Volume e2b1e58a-6b67-479f-9dbf-16f9b5f15d9d could not be found. Jun 14 18:27:03.628762 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-ead292ef-32f2-4f74-a086-04c4fe0118df tempest-VolumesNegativeTest-1654288863 tempest-VolumesNegativeTest-1654288863-project] Request method failure captured: Jun 14 18:27:03.628762 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: request: DELETE /compute/v2.1/os-volumes/e2b1e58a-6b67-479f-9dbf-16f9b5f15d9d HTTP/1.1 Jun 14 18:27:03.628762 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept: application/json Jun 14 18:27:03.628762 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept-Encoding: identity Jun 14 18:27:03.628762 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Connection: close Jun 14 18:27:03.628762 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Length: 0 Jun 14 18:27:03.628762 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Type: application/json Jun 14 18:27:03.628762 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Host: 10.222.0.78 Jun 14 18:27:03.628762 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Openstack-System-Scope: None Jun 14 18:27:03.628762 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: User-Agent: python-urllib3/1.26.9 Jun 14 18:27:03.628762 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Auth-Token: gAAAAABiqNLzupgy5hd8quS8Wx9lTSm5AKsd8HPQbh9wC74M5l66PhHjaA-2MlEBABkApNZ9iqaPqfs5DD1kkrhleIV1Wc-IC-JXp6E-etJnoKtDQJjsEzzm-7oZ6AyZkSBZHdlGI0u-O5l3yVOjqTV6Esl3tgyhWjh8y7SqLrB3vmFbumqjHvg Jun 14 18:27:03.628762 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Id: None Jun 14 18:27:03.628762 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Name: None Jun 14 18:27:03.628762 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Identity-Status: Confirmed Jun 14 18:27:03.628762 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Is-Admin-Project: True Jun 14 18:27:03.628762 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Id: default Jun 14 18:27:03.628762 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Name: Default Jun 14 18:27:03.628762 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Id: daf8bccbe7044c1ab743fcfb238b3ffe Jun 14 18:27:03.628762 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Name: tempest-VolumesNegativeTest-1654288863 Jun 14 18:27:03.628762 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Role: reader,member Jun 14 18:27:03.628762 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Roles: reader,member Jun 14 18:27:03.629947 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_daf8bccbe7044c1ab743fcfb238b3ffe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/daf8bccbe7044c1ab743fcfb238b3ffe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/daf8bccbe7044c1ab743fcfb238b3ffe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/daf8bccbe7044c1ab743fcfb238b3ffe"}]}] Jun 14 18:27:03.629947 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant: tempest-VolumesNegativeTest-1654288863 Jun 14 18:27:03.629947 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Id: daf8bccbe7044c1ab743fcfb238b3ffe Jun 14 18:27:03.629947 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Name: tempest-VolumesNegativeTest-1654288863 Jun 14 18:27:03.629947 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User: tempest-VolumesNegativeTest-1654288863-project Jun 14 18:27:03.629947 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Id: default Jun 14 18:27:03.629947 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Name: Default Jun 14 18:27:03.629947 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Id: 9e01750e0fa54f36822f365d7f1253fe Jun 14 18:27:03.629947 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Name: tempest-VolumesNegativeTest-1654288863-project Jun 14 18:27:03.629947 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: method: Jun 14 18:27:03.629947 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: exception: Volume e2b1e58a-6b67-479f-9dbf-16f9b5f15d9d could not be found. Jun 14 18:27:03.629947 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: action_args: {'id': 'e2b1e58a-6b67-479f-9dbf-16f9b5f15d9d'} Jun 14 18:27:03.629947 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:27:03.630563 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:27:03.630563 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 14 18:27:03.630563 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 14 18:27:03.630563 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 14 18:27:03.630563 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 14 18:27:03.630563 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 14 18:27:03.630563 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 14 18:27:03.630563 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 14 18:27:03.630563 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 14 18:27:03.630563 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 14 18:27:03.630563 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 14 18:27:03.630563 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 18:27:03.630563 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 18:27:03.630563 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 18:27:03.630563 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 18:27:03.630563 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e2b1e58a-6b67-479f-9dbf-16f9b5f15d9d could not be found. (HTTP 404) (Request-ID: req-a282d7d1-b789-46d1-b726-bb5b442a6174) Jun 14 18:27:03.630563 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:27:03.630563 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:27:03.630563 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:27:03.631452 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:27:03.631452 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 14 18:27:03.631452 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 14 18:27:03.631452 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 14 18:27:03.631452 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 14 18:27:03.631452 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 14 18:27:03.631452 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 14 18:27:03.631452 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 14 18:27:03.631452 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 14 18:27:03.631452 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 14 18:27:03.631452 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 14 18:27:03.631452 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 14 18:27:03.631452 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 14 18:27:03.631452 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 14 18:27:03.631452 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 14 18:27:03.631452 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 14 18:27:03.631452 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 14 18:27:03.631452 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 14 18:27:03.631452 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 14 18:27:03.632282 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 18:27:03.632282 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 18:27:03.632282 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 18:27:03.632282 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 18:27:03.632282 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e2b1e58a-6b67-479f-9dbf-16f9b5f15d9d could not be found. Jun 14 18:27:03.632282 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:27:03.632282 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:27:03.632282 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:27:03.632282 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:27:03.632282 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:27:03.632282 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:27:03.632282 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:27:03.632282 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:27:03.632282 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 14 18:27:03.632282 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 14 18:27:03.632282 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:27:03.632282 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:27:03.632282 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 14 18:27:03.632282 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:27:03.633247 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e2b1e58a-6b67-479f-9dbf-16f9b5f15d9d could not be found. Jun 14 18:27:03.633247 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:27:03.633247 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:27:03.633247 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:27:03.633247 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:27:03.633247 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:27:03.633247 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:27:03.633247 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:27:03.633247 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:27:03.633247 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e2b1e58a-6b67-479f-9dbf-16f9b5f15d9d could not be found. Jun 14 18:27:03.633247 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:27:03.638159 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-ead292ef-32f2-4f74-a086-04c4fe0118df tempest-VolumesNegativeTest-1654288863 tempest-VolumesNegativeTest-1654288863-project] Returning 404 to user: Volume e2b1e58a-6b67-479f-9dbf-16f9b5f15d9d could not be found. {{(pid=118624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:27:03.639407 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-ead292ef-32f2-4f74-a086-04c4fe0118df tempest-VolumesNegativeTest-1654288863 tempest-VolumesNegativeTest-1654288863-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/e2b1e58a-6b67-479f-9dbf-16f9b5f15d9d" status: 404 len: 109 microversion: 2.1 time: 0.334109 Jun 14 18:27:03.640209 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 8/11] 10.222.0.78 () {58 vars in 1247 bytes} [Tue Jun 14 18:27:03 2022] DELETE /compute/v2.1/os-volumes/e2b1e58a-6b67-479f-9dbf-16f9b5f15d9d => generated 109 bytes in 335 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 14 18:27:03.655495 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-94cdc40f-0c56-496a-b256-550f0bb6f8e1 tempest-VolumesNegativeTest-1654288863 tempest-VolumesNegativeTest-1654288863-project] Calling method '.version_select at 0x7efe7211e4c0>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:03.738176 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.wsgi [None req-94cdc40f-0c56-496a-b256-550f0bb6f8e1 tempest-VolumesNegativeTest-1654288863 tempest-VolumesNegativeTest-1654288863-project] HTTP exception thrown: Volume 2c1d7dbe-4357-43a8-9fd4-60202603e71e could not be found. Jun 14 18:27:03.745413 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-94cdc40f-0c56-496a-b256-550f0bb6f8e1 tempest-VolumesNegativeTest-1654288863 tempest-VolumesNegativeTest-1654288863-project] Request method failure captured: Jun 14 18:27:03.745413 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: request: GET /compute/v2.1/os-volumes/2c1d7dbe-4357-43a8-9fd4-60202603e71e HTTP/1.1 Jun 14 18:27:03.745413 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept: application/json Jun 14 18:27:03.745413 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept-Encoding: identity Jun 14 18:27:03.745413 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Connection: close Jun 14 18:27:03.745413 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Length: 0 Jun 14 18:27:03.745413 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Type: application/json Jun 14 18:27:03.745413 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Host: 10.222.0.78 Jun 14 18:27:03.745413 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Openstack-System-Scope: None Jun 14 18:27:03.745413 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: User-Agent: python-urllib3/1.26.9 Jun 14 18:27:03.745413 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Auth-Token: gAAAAABiqNLzupgy5hd8quS8Wx9lTSm5AKsd8HPQbh9wC74M5l66PhHjaA-2MlEBABkApNZ9iqaPqfs5DD1kkrhleIV1Wc-IC-JXp6E-etJnoKtDQJjsEzzm-7oZ6AyZkSBZHdlGI0u-O5l3yVOjqTV6Esl3tgyhWjh8y7SqLrB3vmFbumqjHvg Jun 14 18:27:03.745413 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Id: None Jun 14 18:27:03.745413 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Name: None Jun 14 18:27:03.745413 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Identity-Status: Confirmed Jun 14 18:27:03.745413 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Is-Admin-Project: True Jun 14 18:27:03.745413 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Id: default Jun 14 18:27:03.745413 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Name: Default Jun 14 18:27:03.745413 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Id: daf8bccbe7044c1ab743fcfb238b3ffe Jun 14 18:27:03.745413 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Name: tempest-VolumesNegativeTest-1654288863 Jun 14 18:27:03.745413 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Role: reader,member Jun 14 18:27:03.745413 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Roles: reader,member Jun 14 18:27:03.747765 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_daf8bccbe7044c1ab743fcfb238b3ffe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/daf8bccbe7044c1ab743fcfb238b3ffe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/daf8bccbe7044c1ab743fcfb238b3ffe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/daf8bccbe7044c1ab743fcfb238b3ffe"}]}] Jun 14 18:27:03.747765 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant: tempest-VolumesNegativeTest-1654288863 Jun 14 18:27:03.747765 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Id: daf8bccbe7044c1ab743fcfb238b3ffe Jun 14 18:27:03.747765 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Name: tempest-VolumesNegativeTest-1654288863 Jun 14 18:27:03.747765 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User: tempest-VolumesNegativeTest-1654288863-project Jun 14 18:27:03.747765 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Id: default Jun 14 18:27:03.747765 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Name: Default Jun 14 18:27:03.747765 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Id: 9e01750e0fa54f36822f365d7f1253fe Jun 14 18:27:03.747765 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Name: tempest-VolumesNegativeTest-1654288863-project Jun 14 18:27:03.747765 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: method: Jun 14 18:27:03.747765 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: exception: Volume 2c1d7dbe-4357-43a8-9fd4-60202603e71e could not be found. Jun 14 18:27:03.747765 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: action_args: {'id': '2c1d7dbe-4357-43a8-9fd4-60202603e71e'} Jun 14 18:27:03.747765 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:27:03.748861 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:27:03.748861 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 14 18:27:03.748861 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 14 18:27:03.748861 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 14 18:27:03.748861 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 14 18:27:03.748861 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 14 18:27:03.748861 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 14 18:27:03.748861 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 14 18:27:03.748861 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 14 18:27:03.748861 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 14 18:27:03.748861 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 14 18:27:03.748861 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 18:27:03.748861 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 18:27:03.748861 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 18:27:03.748861 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 18:27:03.748861 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2c1d7dbe-4357-43a8-9fd4-60202603e71e could not be found. (HTTP 404) (Request-ID: req-ca7a84e1-91f2-4acb-b6e1-48c379871ccc) Jun 14 18:27:03.748861 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:27:03.748861 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:27:03.748861 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:27:03.749998 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:27:03.749998 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 14 18:27:03.749998 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 14 18:27:03.749998 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 14 18:27:03.749998 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 14 18:27:03.749998 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 14 18:27:03.749998 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 14 18:27:03.749998 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 14 18:27:03.749998 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 14 18:27:03.749998 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 14 18:27:03.749998 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 14 18:27:03.749998 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 14 18:27:03.749998 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 14 18:27:03.749998 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 14 18:27:03.749998 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 14 18:27:03.749998 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 14 18:27:03.749998 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 14 18:27:03.749998 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 14 18:27:03.749998 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 14 18:27:03.750814 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 18:27:03.750814 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 18:27:03.750814 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 18:27:03.750814 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 18:27:03.750814 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2c1d7dbe-4357-43a8-9fd4-60202603e71e could not be found. Jun 14 18:27:03.750814 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:27:03.750814 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:27:03.750814 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:27:03.750814 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:27:03.750814 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:27:03.750814 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:27:03.750814 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:27:03.750814 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:27:03.750814 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 14 18:27:03.750814 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 14 18:27:03.750814 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:27:03.750814 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:27:03.750814 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 14 18:27:03.750814 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:27:03.751638 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2c1d7dbe-4357-43a8-9fd4-60202603e71e could not be found. Jun 14 18:27:03.751638 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:27:03.751638 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:27:03.751638 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:27:03.751638 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:27:03.751638 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:27:03.751638 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:27:03.751638 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:27:03.751638 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:27:03.751638 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2c1d7dbe-4357-43a8-9fd4-60202603e71e could not be found. Jun 14 18:27:03.751638 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:27:03.751638 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-94cdc40f-0c56-496a-b256-550f0bb6f8e1 tempest-VolumesNegativeTest-1654288863 tempest-VolumesNegativeTest-1654288863-project] Returning 404 to user: Volume 2c1d7dbe-4357-43a8-9fd4-60202603e71e could not be found. {{(pid=118623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:27:03.751638 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-94cdc40f-0c56-496a-b256-550f0bb6f8e1 tempest-VolumesNegativeTest-1654288863 tempest-VolumesNegativeTest-1654288863-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/2c1d7dbe-4357-43a8-9fd4-60202603e71e" status: 404 len: 109 microversion: 2.1 time: 0.102340 Jun 14 18:27:03.768211 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 4/12] 10.222.0.78 () {58 vars in 1244 bytes} [Tue Jun 14 18:27:03 2022] GET /compute/v2.1/os-volumes/2c1d7dbe-4357-43a8-9fd4-60202603e71e => generated 109 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:27:04.113394 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-602a46f7-1c69-4015-ad17-10af72df7b0b tempest-VolumesGetTestJSON-1542263720 tempest-VolumesGetTestJSON-1542263720-project] Calling method '.version_select at 0x7efe729d3d30>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:04.280955 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-602a46f7-1c69-4015-ad17-10af72df7b0b tempest-VolumesGetTestJSON-1542263720 tempest-VolumesGetTestJSON-1542263720-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/809ced5d-9019-477a-81bd-1b926e142d96" status: 200 len: 352 microversion: 2.1 time: 0.190042 Jun 14 18:27:04.281642 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 9/13] 10.222.0.78 () {58 vars in 1244 bytes} [Tue Jun 14 18:27:04 2022] GET /compute/v2.1/os-volumes/809ced5d-9019-477a-81bd-1b926e142d96 => generated 352 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:27:04.503726 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-de178932-5659-48cc-a8f4-e621b9d00817 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:04.504199 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-de178932-5659-48cc-a8f4-e621b9d00817 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] [instance: 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:04.638829 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-de178932-5659-48cc-a8f4-e621b9d00817 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419d0cc6ca7e426cb28257b32037901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea8b1ec08d6485ab1ac360549789d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:04.663582 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-de178932-5659-48cc-a8f4-e621b9d00817 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] 10.222.0.78 "GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd" status: 200 len: 1214 microversion: 2.1 time: 0.164628 Jun 14 18:27:04.664618 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 5/14] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:04 2022] GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd => generated 1214 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:05.296514 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-f9c79331-6083-4124-91a6-0393fc0d93e5 tempest-VolumesGetTestJSON-1542263720 tempest-VolumesGetTestJSON-1542263720-project] Calling method '.version_select at 0x7efe729eac10>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:05.448754 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-f9c79331-6083-4124-91a6-0393fc0d93e5 tempest-VolumesGetTestJSON-1542263720 tempest-VolumesGetTestJSON-1542263720-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/809ced5d-9019-477a-81bd-1b926e142d96" status: 200 len: 353 microversion: 2.1 time: 0.156064 Jun 14 18:27:05.457436 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 10/15] 10.222.0.78 () {58 vars in 1244 bytes} [Tue Jun 14 18:27:05 2022] GET /compute/v2.1/os-volumes/809ced5d-9019-477a-81bd-1b926e142d96 => generated 353 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:27:05.467254 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-cf73289a-21f7-4018-97cb-59c95ee34397 tempest-VolumesGetTestJSON-1542263720 tempest-VolumesGetTestJSON-1542263720-project] Calling method '.version_select at 0x7efe71877280>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:05.603964 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-cf73289a-21f7-4018-97cb-59c95ee34397 tempest-VolumesGetTestJSON-1542263720 tempest-VolumesGetTestJSON-1542263720-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/809ced5d-9019-477a-81bd-1b926e142d96" status: 200 len: 353 microversion: 2.1 time: 0.140894 Jun 14 18:27:05.605067 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 6/16] 10.222.0.78 () {58 vars in 1244 bytes} [Tue Jun 14 18:27:05 2022] GET /compute/v2.1/os-volumes/809ced5d-9019-477a-81bd-1b926e142d96 => generated 353 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:27:05.622850 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-cd3a8e24-0f8d-4008-8050-8951b6c3298a tempest-VolumesGetTestJSON-1542263720 tempest-VolumesGetTestJSON-1542263720-project] Calling method '.version_select at 0x7efe729ea430>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:05.686933 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-4a1490dc-0fc2-4ec1-b5af-7718e9c4f17b tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:05.687695 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-4a1490dc-0fc2-4ec1-b5af-7718e9c4f17b tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] [instance: 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:05.867417 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-4a1490dc-0fc2-4ec1-b5af-7718e9c4f17b tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419d0cc6ca7e426cb28257b32037901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea8b1ec08d6485ab1ac360549789d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:05.880875 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-4a1490dc-0fc2-4ec1-b5af-7718e9c4f17b tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] 10.222.0.78 "GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd" status: 200 len: 1214 microversion: 2.1 time: 0.200231 Jun 14 18:27:05.882379 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 7/17] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:05 2022] GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd => generated 1214 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:27:06.063570 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-cd3a8e24-0f8d-4008-8050-8951b6c3298a tempest-VolumesGetTestJSON-1542263720 tempest-VolumesGetTestJSON-1542263720-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/809ced5d-9019-477a-81bd-1b926e142d96" status: 202 len: 0 microversion: 2.1 time: 0.444162 Jun 14 18:27:06.064223 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 11/18] 10.222.0.78 () {58 vars in 1247 bytes} [Tue Jun 14 18:27:05 2022] DELETE /compute/v2.1/os-volumes/809ced5d-9019-477a-81bd-1b926e142d96 => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:27:06.073177 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-912d0716-d494-4219-a003-b7166571a50b tempest-VolumesGetTestJSON-1542263720 tempest-VolumesGetTestJSON-1542263720-project] Calling method '.version_select at 0x7efe718774c0>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:06.220368 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-912d0716-d494-4219-a003-b7166571a50b tempest-VolumesGetTestJSON-1542263720 tempest-VolumesGetTestJSON-1542263720-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/809ced5d-9019-477a-81bd-1b926e142d96" status: 200 len: 352 microversion: 2.1 time: 0.152008 Jun 14 18:27:06.221661 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 8/19] 10.222.0.78 () {58 vars in 1244 bytes} [Tue Jun 14 18:27:06 2022] GET /compute/v2.1/os-volumes/809ced5d-9019-477a-81bd-1b926e142d96 => generated 352 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:27:06.910583 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-7fa3ccff-19c4-4d9e-8678-7c02384bb7d3 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:06.911405 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-7fa3ccff-19c4-4d9e-8678-7c02384bb7d3 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] [instance: 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:06.968431 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7fa3ccff-19c4-4d9e-8678-7c02384bb7d3 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:06.969167 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7fa3ccff-19c4-4d9e-8678-7c02384bb7d3 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:06.970177 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7fa3ccff-19c4-4d9e-8678-7c02384bb7d3 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:06.970919 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7fa3ccff-19c4-4d9e-8678-7c02384bb7d3 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:07.237622 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-92cb17a4-d969-4016-8e15-e1eee7a7e65f tempest-VolumesGetTestJSON-1542263720 tempest-VolumesGetTestJSON-1542263720-project] Calling method '.version_select at 0x7efe72b685e0>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:07.298156 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.wsgi [None req-92cb17a4-d969-4016-8e15-e1eee7a7e65f tempest-VolumesGetTestJSON-1542263720 tempest-VolumesGetTestJSON-1542263720-project] HTTP exception thrown: Volume 809ced5d-9019-477a-81bd-1b926e142d96 could not be found. Jun 14 18:27:07.300286 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-92cb17a4-d969-4016-8e15-e1eee7a7e65f tempest-VolumesGetTestJSON-1542263720 tempest-VolumesGetTestJSON-1542263720-project] Request method failure captured: Jun 14 18:27:07.300286 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: request: GET /compute/v2.1/os-volumes/809ced5d-9019-477a-81bd-1b926e142d96 HTTP/1.1 Jun 14 18:27:07.300286 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept: application/json Jun 14 18:27:07.300286 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept-Encoding: identity Jun 14 18:27:07.300286 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Connection: close Jun 14 18:27:07.300286 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Length: 0 Jun 14 18:27:07.300286 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Type: application/json Jun 14 18:27:07.300286 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Host: 10.222.0.78 Jun 14 18:27:07.300286 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Openstack-System-Scope: None Jun 14 18:27:07.300286 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: User-Agent: python-urllib3/1.26.9 Jun 14 18:27:07.300286 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Auth-Token: gAAAAABiqNLzEBfdkXloakwmrVSETEq7wHb2Dm6QPZkeqiDd9VeiBZXyxORq5fyTNMBTG7DJertS19b84OJdsGG7B-NrUeUpwxAqvVMt9hQQmAOkxZX-xCZGhKRxIV0NbMot0lXJf8n6k7JcVZWbFsRy9SGBB4-7f1aofFeV6rC-ftElsICt4zA Jun 14 18:27:07.300286 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Id: None Jun 14 18:27:07.300286 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Name: None Jun 14 18:27:07.300286 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Identity-Status: Confirmed Jun 14 18:27:07.300286 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Is-Admin-Project: True Jun 14 18:27:07.300286 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Id: default Jun 14 18:27:07.300286 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Name: Default Jun 14 18:27:07.300286 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Id: bb7ad97bdf7b4e9485f9e5c320d3376c Jun 14 18:27:07.300286 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Name: tempest-VolumesGetTestJSON-1542263720 Jun 14 18:27:07.300286 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Role: reader,member Jun 14 18:27:07.300286 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Roles: reader,member Jun 14 18:27:07.301347 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_bb7ad97bdf7b4e9485f9e5c320d3376c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bb7ad97bdf7b4e9485f9e5c320d3376c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bb7ad97bdf7b4e9485f9e5c320d3376c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/bb7ad97bdf7b4e9485f9e5c320d3376c"}]}] Jun 14 18:27:07.301347 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant: tempest-VolumesGetTestJSON-1542263720 Jun 14 18:27:07.301347 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Id: bb7ad97bdf7b4e9485f9e5c320d3376c Jun 14 18:27:07.301347 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Name: tempest-VolumesGetTestJSON-1542263720 Jun 14 18:27:07.301347 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User: tempest-VolumesGetTestJSON-1542263720-project Jun 14 18:27:07.301347 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Id: default Jun 14 18:27:07.301347 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Name: Default Jun 14 18:27:07.301347 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Id: 065e0b6d4a2a49bdbbb04b22fff4ef63 Jun 14 18:27:07.301347 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Name: tempest-VolumesGetTestJSON-1542263720-project Jun 14 18:27:07.301347 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: method: Jun 14 18:27:07.301347 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: exception: Volume 809ced5d-9019-477a-81bd-1b926e142d96 could not be found. Jun 14 18:27:07.301347 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: action_args: {'id': '809ced5d-9019-477a-81bd-1b926e142d96'} Jun 14 18:27:07.301347 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:27:07.302043 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:27:07.302043 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 14 18:27:07.302043 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 14 18:27:07.302043 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 14 18:27:07.302043 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 14 18:27:07.302043 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 14 18:27:07.302043 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 14 18:27:07.302043 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 14 18:27:07.302043 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 14 18:27:07.302043 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 14 18:27:07.302043 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 14 18:27:07.302043 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 18:27:07.302043 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 18:27:07.302043 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 18:27:07.302043 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 18:27:07.302043 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 809ced5d-9019-477a-81bd-1b926e142d96 could not be found. (HTTP 404) (Request-ID: req-cba26a7c-ccbd-4cdc-b037-f78aed2cc20b) Jun 14 18:27:07.302043 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:27:07.302043 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:27:07.302043 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:27:07.302940 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:27:07.302940 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 14 18:27:07.302940 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 14 18:27:07.302940 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 14 18:27:07.302940 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 14 18:27:07.302940 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 14 18:27:07.302940 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 14 18:27:07.302940 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 14 18:27:07.302940 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 14 18:27:07.302940 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 14 18:27:07.302940 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 14 18:27:07.302940 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 14 18:27:07.302940 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 14 18:27:07.302940 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 14 18:27:07.302940 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 14 18:27:07.302940 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 14 18:27:07.302940 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 14 18:27:07.302940 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 14 18:27:07.302940 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 14 18:27:07.303828 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 18:27:07.303828 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 18:27:07.303828 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 18:27:07.303828 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 18:27:07.303828 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 809ced5d-9019-477a-81bd-1b926e142d96 could not be found. Jun 14 18:27:07.303828 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:27:07.303828 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:27:07.303828 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:27:07.303828 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:27:07.303828 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:27:07.303828 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:27:07.303828 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:27:07.303828 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:27:07.303828 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 14 18:27:07.303828 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 14 18:27:07.303828 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:27:07.303828 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:27:07.303828 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 14 18:27:07.303828 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:27:07.304694 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 809ced5d-9019-477a-81bd-1b926e142d96 could not be found. Jun 14 18:27:07.304694 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:27:07.304694 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:27:07.304694 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:27:07.304694 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:27:07.304694 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:27:07.304694 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:27:07.304694 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:27:07.304694 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:27:07.304694 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 809ced5d-9019-477a-81bd-1b926e142d96 could not be found. Jun 14 18:27:07.304694 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:27:07.304694 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-92cb17a4-d969-4016-8e15-e1eee7a7e65f tempest-VolumesGetTestJSON-1542263720 tempest-VolumesGetTestJSON-1542263720-project] Returning 404 to user: Volume 809ced5d-9019-477a-81bd-1b926e142d96 could not be found. {{(pid=118623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:27:07.304694 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-92cb17a4-d969-4016-8e15-e1eee7a7e65f tempest-VolumesGetTestJSON-1542263720 tempest-VolumesGetTestJSON-1542263720-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/809ced5d-9019-477a-81bd-1b926e142d96" status: 404 len: 109 microversion: 2.1 time: 0.069220 Jun 14 18:27:07.304694 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 9/20] 10.222.0.78 () {58 vars in 1244 bytes} [Tue Jun 14 18:27:07 2022] GET /compute/v2.1/os-volumes/809ced5d-9019-477a-81bd-1b926e142d96 => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 14 18:27:07.858198 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-7fa3ccff-19c4-4d9e-8678-7c02384bb7d3 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419d0cc6ca7e426cb28257b32037901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea8b1ec08d6485ab1ac360549789d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:07.888175 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-7fa3ccff-19c4-4d9e-8678-7c02384bb7d3 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] 10.222.0.78 "GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd" status: 200 len: 1210 microversion: 2.1 time: 0.991203 Jun 14 18:27:07.889682 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 12/21] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:06 2022] GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd => generated 1210 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:08.909729 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-88d6ae26-4f73-49ae-a5ac-044b4e94120a tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:08.912810 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-88d6ae26-4f73-49ae-a5ac-044b4e94120a tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] [instance: 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:08.938005 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-88d6ae26-4f73-49ae-a5ac-044b4e94120a tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:08.938828 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-88d6ae26-4f73-49ae-a5ac-044b4e94120a tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:08.939809 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-88d6ae26-4f73-49ae-a5ac-044b4e94120a tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:08.940384 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-88d6ae26-4f73-49ae-a5ac-044b4e94120a tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:09.378049 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-88d6ae26-4f73-49ae-a5ac-044b4e94120a tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419d0cc6ca7e426cb28257b32037901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea8b1ec08d6485ab1ac360549789d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:09.393763 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-88d6ae26-4f73-49ae-a5ac-044b4e94120a tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] 10.222.0.78 "GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd" status: 200 len: 1274 microversion: 2.1 time: 0.489889 Jun 14 18:27:09.398258 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 10/22] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:08 2022] GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd => generated 1274 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:10.427428 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-0194eb50-b98e-4691-87fa-e6d14958660d tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:10.428120 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-0194eb50-b98e-4691-87fa-e6d14958660d tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] [instance: 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:10.435015 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-0194eb50-b98e-4691-87fa-e6d14958660d tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:10.435672 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-0194eb50-b98e-4691-87fa-e6d14958660d tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:10.436639 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-0194eb50-b98e-4691-87fa-e6d14958660d tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:10.437374 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-0194eb50-b98e-4691-87fa-e6d14958660d tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:10.596424 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-0194eb50-b98e-4691-87fa-e6d14958660d tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419d0cc6ca7e426cb28257b32037901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea8b1ec08d6485ab1ac360549789d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:10.610436 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-0194eb50-b98e-4691-87fa-e6d14958660d tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] 10.222.0.78 "GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd" status: 200 len: 1284 microversion: 2.1 time: 0.185436 Jun 14 18:27:10.612085 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 13/23] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:10 2022] GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd => generated 1284 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:11.638734 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-50470b48-6447-4fda-ad92-37b1e9112e5c tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:11.639380 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-50470b48-6447-4fda-ad92-37b1e9112e5c tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] [instance: 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:11.653209 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-50470b48-6447-4fda-ad92-37b1e9112e5c tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:11.653707 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-50470b48-6447-4fda-ad92-37b1e9112e5c tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:11.654501 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-50470b48-6447-4fda-ad92-37b1e9112e5c tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:11.654936 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-50470b48-6447-4fda-ad92-37b1e9112e5c tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:12.110888 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-50470b48-6447-4fda-ad92-37b1e9112e5c tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419d0cc6ca7e426cb28257b32037901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea8b1ec08d6485ab1ac360549789d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:12.124643 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-50470b48-6447-4fda-ad92-37b1e9112e5c tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] 10.222.0.78 "GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd" status: 200 len: 1272 microversion: 2.1 time: 0.497657 Jun 14 18:27:12.125808 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 11/24] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:11 2022] GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd => generated 1272 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:13.154764 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-b27bcad2-985a-4613-90ec-ac774de51408 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:13.156248 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-b27bcad2-985a-4613-90ec-ac774de51408 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] [instance: 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:13.241210 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b27bcad2-985a-4613-90ec-ac774de51408 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:13.241900 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b27bcad2-985a-4613-90ec-ac774de51408 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:13.242735 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b27bcad2-985a-4613-90ec-ac774de51408 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:13.243173 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b27bcad2-985a-4613-90ec-ac774de51408 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:13.417225 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-b27bcad2-985a-4613-90ec-ac774de51408 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419d0cc6ca7e426cb28257b32037901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea8b1ec08d6485ab1ac360549789d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:13.432245 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-b27bcad2-985a-4613-90ec-ac774de51408 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] 10.222.0.78 "GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd" status: 200 len: 1272 microversion: 2.1 time: 0.284907 Jun 14 18:27:13.432862 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 14/25] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:13 2022] GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd => generated 1272 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:14.459650 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-5da97935-ca69-478f-ae8b-7d35dfe02bc9 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:14.460541 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-5da97935-ca69-478f-ae8b-7d35dfe02bc9 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] [instance: 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:14.476981 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell0:SELECT=2 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:27:14.488269 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5da97935-ca69-478f-ae8b-7d35dfe02bc9 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:14.488968 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5da97935-ca69-478f-ae8b-7d35dfe02bc9 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:14.489861 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5da97935-ca69-478f-ae8b-7d35dfe02bc9 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:14.490314 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5da97935-ca69-478f-ae8b-7d35dfe02bc9 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:15.885921 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell0:SELECT=12 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:27:16.127909 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-5da97935-ca69-478f-ae8b-7d35dfe02bc9 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419d0cc6ca7e426cb28257b32037901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea8b1ec08d6485ab1ac360549789d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:16.166733 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-5da97935-ca69-478f-ae8b-7d35dfe02bc9 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] 10.222.0.78 "GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd" status: 200 len: 1314 microversion: 2.1 time: 1.707177 Jun 14 18:27:16.172060 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 12/26] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:14 2022] GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd => generated 1314 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:17.064642 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-c8e6ede5-848e-471a-b5bb-e1190c1c5709 tempest-VolumesTestJSON-83142030 tempest-VolumesTestJSON-83142030-project] Calling method '.version_select at 0x7efe728d9430>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:17.119535 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-c8e6ede5-848e-471a-b5bb-e1190c1c5709 tempest-VolumesTestJSON-83142030 tempest-VolumesTestJSON-83142030-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/73b8ba46-994c-4c50-b852-8a1c91f53f3c" status: 200 len: 351 microversion: 2.1 time: 0.235077 Jun 14 18:27:17.120545 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 15/27] 10.222.0.78 () {58 vars in 1244 bytes} [Tue Jun 14 18:27:16 2022] GET /compute/v2.1/os-volumes/73b8ba46-994c-4c50-b852-8a1c91f53f3c => generated 351 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:27:17.194533 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-d8d726f1-09ac-4c23-9434-a746cf1f0f8f tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:17.198594 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-d8d726f1-09ac-4c23-9434-a746cf1f0f8f tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] [instance: 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:17.237122 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d8d726f1-09ac-4c23-9434-a746cf1f0f8f tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:17.242482 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d8d726f1-09ac-4c23-9434-a746cf1f0f8f tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:17.247906 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d8d726f1-09ac-4c23-9434-a746cf1f0f8f tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:17.252586 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d8d726f1-09ac-4c23-9434-a746cf1f0f8f tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:18.325626 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-b8b97b33-d35d-4d78-8ee5-875f6bd208bd tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Action: 'create', calling method: .version_select at 0x7efe728ba550>, body: {"keypair": {"name": "tempest-keypair-724170124", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAePaY7MfZwMtxp0MlLWMpqARVTcEt5zzWwcIRsYfq9CD1qQcfPlkFtFCNS3Q+zblNY9sO/F+W10NJJY4f1XGoH+P/vpi2bGUkVplhWVgN3uMraQOF8W8OXDs9DDQ4jTQ=="}} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:27:18.516862 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.quota [None req-b8b97b33-d35d-4d78-8ee5-875f6bd208bd tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Getting quotas for project e8603a3b1604479da86224c52c2467ad. Resources: {'key_pairs'} {{(pid=118624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:27:18.529390 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.quota [None req-b8b97b33-d35d-4d78-8ee5-875f6bd208bd tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Getting quotas for user 76baaf45903d4c53ab3e0fe459b228ea and project e8603a3b1604479da86224c52c2467ad. Resources: {'key_pairs'} {{(pid=118624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:27:18.686338 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-d8d726f1-09ac-4c23-9434-a746cf1f0f8f tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419d0cc6ca7e426cb28257b32037901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea8b1ec08d6485ab1ac360549789d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:18.763592 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-d8d726f1-09ac-4c23-9434-a746cf1f0f8f tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] 10.222.0.78 "GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd" status: 200 len: 1314 microversion: 2.1 time: 1.570787 Jun 14 18:27:18.771586 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 13/28] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:17 2022] GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd => generated 1314 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:18.874194 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-b8b97b33-d35d-4d78-8ee5-875f6bd208bd tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.992449 Jun 14 18:27:18.875541 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 16/29] 10.222.0.78 () {62 vars in 1199 bytes} [Tue Jun 14 18:27:17 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 994 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 14 18:27:19.787193 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-f997f96d-e3d9-4257-bf51-759f5e90881c tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:19.788643 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-f997f96d-e3d9-4257-bf51-759f5e90881c tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] [instance: 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:19.808973 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f997f96d-e3d9-4257-bf51-759f5e90881c tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:19.809937 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f997f96d-e3d9-4257-bf51-759f5e90881c tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:19.817772 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f997f96d-e3d9-4257-bf51-759f5e90881c tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:19.819237 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f997f96d-e3d9-4257-bf51-759f5e90881c tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:20.473071 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-082b07c3-b83e-4e4d-b93e-841f5fef592f tempest-VolumesTestJSON-83142030 tempest-VolumesTestJSON-83142030-project] Calling method '.version_select at 0x7efe72808d30>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:20.720784 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-082b07c3-b83e-4e4d-b93e-841f5fef592f tempest-VolumesTestJSON-83142030 tempest-VolumesTestJSON-83142030-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/e8a71870-d475-42de-b8c7-a1fbdd1c876c" status: 200 len: 351 microversion: 2.1 time: 0.252091 Jun 14 18:27:20.731960 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 17/30] 10.222.0.78 () {58 vars in 1244 bytes} [Tue Jun 14 18:27:20 2022] GET /compute/v2.1/os-volumes/e8a71870-d475-42de-b8c7-a1fbdd1c876c => generated 351 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:27:21.114249 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-f997f96d-e3d9-4257-bf51-759f5e90881c tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419d0cc6ca7e426cb28257b32037901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea8b1ec08d6485ab1ac360549789d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:21.126798 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-f997f96d-e3d9-4257-bf51-759f5e90881c tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] 10.222.0.78 "GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd" status: 200 len: 1314 microversion: 2.1 time: 1.344371 Jun 14 18:27:21.145495 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 14/31] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:19 2022] GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd => generated 1314 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:22.153604 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-59862e9d-d963-447a-a875-df64e00de865 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:22.154329 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-59862e9d-d963-447a-a875-df64e00de865 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] [instance: 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:22.167008 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-59862e9d-d963-447a-a875-df64e00de865 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:22.169404 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-59862e9d-d963-447a-a875-df64e00de865 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:22.170950 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-59862e9d-d963-447a-a875-df64e00de865 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:22.173123 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-59862e9d-d963-447a-a875-df64e00de865 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:22.900284 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-59862e9d-d963-447a-a875-df64e00de865 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419d0cc6ca7e426cb28257b32037901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea8b1ec08d6485ab1ac360549789d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:22.911812 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-59862e9d-d963-447a-a875-df64e00de865 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] 10.222.0.78 "GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd" status: 200 len: 1314 microversion: 2.1 time: 0.764691 Jun 14 18:27:22.916639 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 18/32] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:22 2022] GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd => generated 1314 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:23.139854 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-1c3630fe-b25d-49d8-a021-4f0cf7fa5825 tempest-VolumesTestJSON-83142030 tempest-VolumesTestJSON-83142030-project] Calling method '.version_select at 0x7efe72839280>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:23.260311 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-1c3630fe-b25d-49d8-a021-4f0cf7fa5825 tempest-VolumesTestJSON-83142030 tempest-VolumesTestJSON-83142030-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/8ac062fb-7e14-40dc-a44b-3a92db7e589e" status: 200 len: 351 microversion: 2.1 time: 0.121600 Jun 14 18:27:23.279481 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 19/33] 10.222.0.78 () {58 vars in 1244 bytes} [Tue Jun 14 18:27:23 2022] GET /compute/v2.1/os-volumes/8ac062fb-7e14-40dc-a44b-3a92db7e589e => generated 351 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:27:23.288753 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-b6a8a167-9294-4e18-bdfb-975ef84d51f9 tempest-VolumesTestJSON-83142030 tempest-VolumesTestJSON-83142030-project] Calling method '.version_select at 0x7efe72808e50>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:23.482715 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-f17bc74d-37ad-44d5-a08e-79075435e4b3 req-723d2be6-c88e-453b-9488-4f646c2cb27d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd", "tag": "1de4fd5a-d3c5-41de-a140-a242d715583a"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:27:23.519660 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-f17bc74d-37ad-44d5-a08e-79075435e4b3 req-723d2be6-c88e-453b-9488-4f646c2cb27d service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:23.520037 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-f17bc74d-37ad-44d5-a08e-79075435e4b3 req-723d2be6-c88e-453b-9488-4f646c2cb27d service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:23.594985 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-b6a8a167-9294-4e18-bdfb-975ef84d51f9 tempest-VolumesTestJSON-83142030 tempest-VolumesTestJSON-83142030-project] 10.222.0.78 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.313509 Jun 14 18:27:23.595741 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 20/34] 10.222.0.78 () {58 vars in 1133 bytes} [Tue Jun 14 18:27:23 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:23.603227 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-f17bc74d-37ad-44d5-a08e-79075435e4b3 req-723d2be6-c88e-453b-9488-4f646c2cb27d service nova] Creating event network-changed:1de4fd5a-d3c5-41de-a140-a242d715583a for instance 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd on hv-cinder-84456 Jun 14 18:27:23.603227 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-f17bc74d-37ad-44d5-a08e-79075435e4b3 req-723d2be6-c88e-453b-9488-4f646c2cb27d service nova] Acquired lock "compute-rpcapi-router" {{(pid=118623) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 14 18:27:23.603227 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-09c809f9-e183-44e9-9e4c-8ba3eb183eb1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:23.608960 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-fe914b81-3df9-400b-b23b-ee2f878bc32b tempest-VolumesTestJSON-83142030 tempest-VolumesTestJSON-83142030-project] Calling method '.version_select at 0x7efe71fcc790>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:23.618819 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-09c809f9-e183-44e9-9e4c-8ba3eb183eb1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:23.619932 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-09c809f9-e183-44e9-9e4c-8ba3eb183eb1 None None] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:23.620414 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-09c809f9-e183-44e9-9e4c-8ba3eb183eb1 None None] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:23.665277 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.compute.rpcapi [None req-09c809f9-e183-44e9-9e4c-8ba3eb183eb1 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 14 18:27:23.665277 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-09c809f9-e183-44e9-9e4c-8ba3eb183eb1 None None] Releasing lock "compute-rpcapi-router" {{(pid=118623) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 14 18:27:23.715196 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-09c809f9-e183-44e9-9e4c-8ba3eb183eb1 None None] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.713318 Jun 14 18:27:23.716312 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 15/35] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:27:23.896990 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-fe914b81-3df9-400b-b23b-ee2f878bc32b tempest-VolumesTestJSON-83142030 tempest-VolumesTestJSON-83142030-project] 10.222.0.78 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.292017 Jun 14 18:27:23.908755 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 21/36] 10.222.0.78 () {58 vars in 1148 bytes} [Tue Jun 14 18:27:23 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:27:23.914849 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-0e5fb657-38ea-4092-8bb5-5cabb33b152f tempest-VolumesTestJSON-83142030 tempest-VolumesTestJSON-83142030-project] Calling method '.version_select at 0x7efe717c43a0>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:23.935195 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-570ef587-5cff-4f62-9604-8ca9e98b49ed tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:23.936606 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-570ef587-5cff-4f62-9604-8ca9e98b49ed tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] [instance: 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:23.974764 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-570ef587-5cff-4f62-9604-8ca9e98b49ed tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:23.983328 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-570ef587-5cff-4f62-9604-8ca9e98b49ed tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:23.985960 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-570ef587-5cff-4f62-9604-8ca9e98b49ed tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:23.989387 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-570ef587-5cff-4f62-9604-8ca9e98b49ed tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:24.170780 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-0e5fb657-38ea-4092-8bb5-5cabb33b152f tempest-VolumesTestJSON-83142030 tempest-VolumesTestJSON-83142030-project] 10.222.0.78 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.260845 Jun 14 18:27:24.180959 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 16/37] 10.222.0.78 () {58 vars in 1133 bytes} [Tue Jun 14 18:27:23 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:27:24.678470 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-84f25b05-be78-4ce8-967c-a83eeb7837fc tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-315572467", "imageRef": "e2555120-8576-4128-944f-40805aa95a9b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:27:24.876838 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.network.neutron [None req-84f25b05-be78-4ce8-967c-a83eeb7837fc tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] validate_networks() for [('64ebe0b0-052f-4256-be3c-102cc7ed63f3', None, None, None, None, None)] {{(pid=118623) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 18:27:25.688707 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-570ef587-5cff-4f62-9604-8ca9e98b49ed tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419d0cc6ca7e426cb28257b32037901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea8b1ec08d6485ab1ac360549789d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:25.697877 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-570ef587-5cff-4f62-9604-8ca9e98b49ed tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] 10.222.0.78 "GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd" status: 200 len: 1314 microversion: 2.1 time: 1.770453 Jun 14 18:27:25.699062 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 22/38] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:23 2022] GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd => generated 1314 bytes in 1772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:27:25.721355 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-d10ca276-2b6f-417c-8d65-6ee2c7a80d09 tempest-VolumesTestJSON-83142030 tempest-VolumesTestJSON-83142030-project] Calling method '.version_select at 0x7efe71fcc0d0>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:26.018932 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-d10ca276-2b6f-417c-8d65-6ee2c7a80d09 tempest-VolumesTestJSON-83142030 tempest-VolumesTestJSON-83142030-project] 10.222.0.78 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.318465 Jun 14 18:27:26.020747 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 23/39] 10.222.0.78 () {58 vars in 1166 bytes} [Tue Jun 14 18:27:25 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:27:26.035552 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-3c5fd6c3-b5da-4d8e-b217-73183dae5903 tempest-VolumesTestJSON-83142030 tempest-VolumesTestJSON-83142030-project] Calling method '.version_select at 0x7efe71fd7a60>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:26.217312 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-3c5fd6c3-b5da-4d8e-b217-73183dae5903 tempest-VolumesTestJSON-83142030 tempest-VolumesTestJSON-83142030-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.188468 Jun 14 18:27:26.218200 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 24/40] 10.222.0.78 () {58 vars in 1169 bytes} [Tue Jun 14 18:27:26 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:27:26.234598 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-4ee1abed-6307-474e-89ae-d8b988b2e8fa tempest-VolumesTestJSON-83142030 tempest-VolumesTestJSON-83142030-project] Calling method '.version_select at 0x7efe71fe2790>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:26.437901 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-4ee1abed-6307-474e-89ae-d8b988b2e8fa tempest-VolumesTestJSON-83142030 tempest-VolumesTestJSON-83142030-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.207212 Jun 14 18:27:26.439442 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 25/41] 10.222.0.78 () {58 vars in 1154 bytes} [Tue Jun 14 18:27:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:26.452614 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-4f165cec-52c3-4f42-b17e-bef8964be3e3 tempest-VolumesTestJSON-83142030 tempest-VolumesTestJSON-83142030-project] Calling method '.version_select at 0x7efe71fd7f70>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:26.851932 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-4f165cec-52c3-4f42-b17e-bef8964be3e3 tempest-VolumesTestJSON-83142030 tempest-VolumesTestJSON-83142030-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.403961 Jun 14 18:27:26.852811 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 26/42] 10.222.0.78 () {58 vars in 1187 bytes} [Tue Jun 14 18:27:26 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:27:26.858691 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-125fce63-fa27-4e52-a377-1eaf38b08e1e tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:26.860016 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-125fce63-fa27-4e52-a377-1eaf38b08e1e tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] [instance: 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:26.888221 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-125fce63-fa27-4e52-a377-1eaf38b08e1e tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:26.894952 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-125fce63-fa27-4e52-a377-1eaf38b08e1e tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:26.902789 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-125fce63-fa27-4e52-a377-1eaf38b08e1e tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:26.907855 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-125fce63-fa27-4e52-a377-1eaf38b08e1e tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:27.619305 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-125fce63-fa27-4e52-a377-1eaf38b08e1e tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419d0cc6ca7e426cb28257b32037901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea8b1ec08d6485ab1ac360549789d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:27.635338 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-125fce63-fa27-4e52-a377-1eaf38b08e1e tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] 10.222.0.78 "GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd" status: 200 len: 1314 microversion: 2.1 time: 0.781198 Jun 14 18:27:27.642854 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 27/43] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:26 2022] GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd => generated 1314 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:27.658758 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-398d777e-1209-4612-8815-3e55d79610c9 tempest-VolumesTestJSON-83142030 tempest-VolumesTestJSON-83142030-project] Calling method '.version_select at 0x7efe71fd74c0>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:27.816483 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-84f25b05-be78-4ce8-967c-a83eeb7837fc tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Flavor limits 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 18:27:27.816483 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-84f25b05-be78-4ce8-967c-a83eeb7837fc tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Image limits 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 18:27:27.817119 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-84f25b05-be78-4ce8-967c-a83eeb7837fc tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Flavor pref 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 18:27:27.817709 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-84f25b05-be78-4ce8-967c-a83eeb7837fc tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Image pref 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 18:27:27.818696 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-84f25b05-be78-4ce8-967c-a83eeb7837fc tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 18:27:27.842502 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-84f25b05-be78-4ce8-967c-a83eeb7837fc tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:27.844054 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-84f25b05-be78-4ce8-967c-a83eeb7837fc tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:27.846972 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-84f25b05-be78-4ce8-967c-a83eeb7837fc tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:27.848214 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-84f25b05-be78-4ce8-967c-a83eeb7837fc tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:27.882198 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.quota [None req-84f25b05-be78-4ce8-967c-a83eeb7837fc tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Getting quotas for project a5c99e2733b440cc99c9749761f4b4cd. Resources: {'instances', 'cores', 'ram'} {{(pid=118623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:27:27.888671 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.quota [None req-84f25b05-be78-4ce8-967c-a83eeb7837fc tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Getting quotas for user 7bf1c044cb3843b4a54edd75a3f04685 and project a5c99e2733b440cc99c9749761f4b4cd. Resources: {'instances', 'cores', 'ram'} {{(pid=118623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:27:27.910788 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-84f25b05-be78-4ce8-967c-a83eeb7837fc tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Going to run 1 instances... {{(pid=118623) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 18:27:27.915691 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-84f25b05-be78-4ce8-967c-a83eeb7837fc tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 99045096-d6ff-4e14-b710-1b1e2dd9a7c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e2555120-8576-4128-944f-40805aa95a9b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118623) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 18:27:27.959597 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-398d777e-1209-4612-8815-3e55d79610c9 tempest-VolumesTestJSON-83142030 tempest-VolumesTestJSON-83142030-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.315749 Jun 14 18:27:27.965297 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 28/44] 10.222.0.78 () {58 vars in 1154 bytes} [Tue Jun 14 18:27:27 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:28.290806 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-84f25b05-be78-4ce8-967c-a83eeb7837fc tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.108236 Jun 14 18:27:28.295680 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 17/45] 10.222.0.78 () {60 vars in 1146 bytes} [Tue Jun 14 18:27:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 4114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 18:27:28.338845 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-3c6f6f7a-81d7-4645-ab14-7524ee60cb04 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:28.340437 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-3c6f6f7a-81d7-4645-ab14-7524ee60cb04 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 99045096-d6ff-4e14-b710-1b1e2dd9a7c5] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:28.375312 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-cbd3fc2b-cc06-4d10-869a-78b51161d085 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Action: 'create', calling method: .version_select at 0x7efe71fe2e50>, body: {"keypair": {"name": "tempest-keypair-1626601001", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwls/jtC0XAdtK6JZAfIyaX4qIZzltY4/SyBaxGoqPnSgsXvCMFiuePHIA5QFOODmtYq2cW/N5ZGIolPYPNhgVVF7ii1w5BSk5Y6zrD/a+G5sDEifJPJTXF7TwrTVbHSQ=="}} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:27:28.400768 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.quota [None req-cbd3fc2b-cc06-4d10-869a-78b51161d085 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Getting quotas for project e2f771a602054b349adae092a9d3ed24. Resources: {'key_pairs'} {{(pid=118624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:27:28.407670 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.quota [None req-cbd3fc2b-cc06-4d10-869a-78b51161d085 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Getting quotas for user 922fd1f30c7647fdb19f8f67a39223cc and project e2f771a602054b349adae092a9d3ed24. Resources: {'key_pairs'} {{(pid=118624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:27:28.525682 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-cbd3fc2b-cc06-4d10-869a-78b51161d085 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.558757 Jun 14 18:27:28.526307 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 29/46] 10.222.0.78 () {60 vars in 1158 bytes} [Tue Jun 14 18:27:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:27:28.660924 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-04ca4050-1b20-4c3c-a204-061c3b4cb050 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:28.661845 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-04ca4050-1b20-4c3c-a204-061c3b4cb050 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] [instance: 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:28.683206 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-04ca4050-1b20-4c3c-a204-061c3b4cb050 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:28.683736 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-04ca4050-1b20-4c3c-a204-061c3b4cb050 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:28.684618 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-04ca4050-1b20-4c3c-a204-061c3b4cb050 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:28.685064 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-04ca4050-1b20-4c3c-a204-061c3b4cb050 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:28.699294 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-3c6f6f7a-81d7-4645-ab14-7524ee60cb04 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:28.733516 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-3c6f6f7a-81d7-4645-ab14-7524ee60cb04 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5" status: 200 len: 1221 microversion: 2.1 time: 0.417032 Jun 14 18:27:28.737479 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 18/47] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:28 2022] GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5 => generated 1221 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:29.243416 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-34877c49-e5d5-414b-a545-7402dbfbff77 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-908272226", "imageRef": "e2555120-8576-4128-944f-40805aa95a9b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:27:29.350968 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-04ca4050-1b20-4c3c-a204-061c3b4cb050 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419d0cc6ca7e426cb28257b32037901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea8b1ec08d6485ab1ac360549789d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:29.379340 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-04ca4050-1b20-4c3c-a204-061c3b4cb050 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] 10.222.0.78 "GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd" status: 200 len: 1314 microversion: 2.1 time: 0.712936 Jun 14 18:27:29.394216 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 30/48] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:28 2022] GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd => generated 1314 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:27:29.462091 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.network.neutron [None req-34877c49-e5d5-414b-a545-7402dbfbff77 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] validate_networks() for [('64ebe0b0-052f-4256-be3c-102cc7ed63f3', None, None, None, None, None)] {{(pid=118623) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 18:27:29.477808 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-074f2085-c522-49bc-9368-b60a5974e116 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-406520140", "imageRef": "e2555120-8576-4128-944f-40805aa95a9b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "274ef244-b114-4d41-92b0-e6c757fabfee"}], "security_groups": [{"name": "tempest-securitygroup--1348435386"}], "key_name": "tempest-keypair-724170124", "user_data": "}} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:27:29.856310 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.network.neutron [None req-074f2085-c522-49bc-9368-b60a5974e116 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] validate_networks() for [('274ef244-b114-4d41-92b0-e6c757fabfee', None, None, None, None, None)] {{(pid=118624) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 18:27:30.977662 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=2 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:27:31.618908 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-34877c49-e5d5-414b-a545-7402dbfbff77 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Flavor limits 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 18:27:31.619900 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-34877c49-e5d5-414b-a545-7402dbfbff77 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Image limits 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 18:27:31.621071 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-34877c49-e5d5-414b-a545-7402dbfbff77 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Flavor pref 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 18:27:31.621760 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-34877c49-e5d5-414b-a545-7402dbfbff77 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Image pref 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 18:27:31.622166 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-34877c49-e5d5-414b-a545-7402dbfbff77 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 18:27:31.624424 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=6 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:27:31.661427 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-34877c49-e5d5-414b-a545-7402dbfbff77 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:31.662910 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-34877c49-e5d5-414b-a545-7402dbfbff77 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:31.665757 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-34877c49-e5d5-414b-a545-7402dbfbff77 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:31.669239 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-34877c49-e5d5-414b-a545-7402dbfbff77 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:31.704711 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell1:SELECT=39 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:27:31.777642 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.quota [None req-34877c49-e5d5-414b-a545-7402dbfbff77 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Getting quotas for project a5c99e2733b440cc99c9749761f4b4cd. Resources: {'instances', 'cores', 'ram'} {{(pid=118623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:27:31.814074 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.quota [None req-34877c49-e5d5-414b-a545-7402dbfbff77 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Getting quotas for user 7bf1c044cb3843b4a54edd75a3f04685 and project a5c99e2733b440cc99c9749761f4b4cd. Resources: {'instances', 'cores', 'ram'} {{(pid=118623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:27:31.860817 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-34877c49-e5d5-414b-a545-7402dbfbff77 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Going to run 1 instances... {{(pid=118623) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 18:27:31.891199 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-34877c49-e5d5-414b-a545-7402dbfbff77 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e2555120-8576-4128-944f-40805aa95a9b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118623) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 18:27:32.005599 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-074f2085-c522-49bc-9368-b60a5974e116 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Flavor limits 0:0:0 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 18:27:32.006774 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-074f2085-c522-49bc-9368-b60a5974e116 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Image limits 0:0:0 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 18:27:32.008064 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-074f2085-c522-49bc-9368-b60a5974e116 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Flavor pref 0:0:0 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 18:27:32.008743 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-074f2085-c522-49bc-9368-b60a5974e116 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Image pref 0:0:0 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 18:27:32.009390 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-074f2085-c522-49bc-9368-b60a5974e116 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 18:27:32.041941 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-074f2085-c522-49bc-9368-b60a5974e116 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:32.043617 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-074f2085-c522-49bc-9368-b60a5974e116 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:32.055522 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-074f2085-c522-49bc-9368-b60a5974e116 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:32.057627 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-074f2085-c522-49bc-9368-b60a5974e116 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:32.091714 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-34877c49-e5d5-414b-a545-7402dbfbff77 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.857702 Jun 14 18:27:32.097492 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 19/49] 10.222.0.78 () {60 vars in 1146 bytes} [Tue Jun 14 18:27:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 2860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 14 18:27:32.098402 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-631d5b72-dc5d-4c75-95a0-fbc4fa4ae60d tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:32.099073 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-631d5b72-dc5d-4c75-95a0-fbc4fa4ae60d tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] [instance: 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:32.107841 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-631d5b72-dc5d-4c75-95a0-fbc4fa4ae60d tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:32.114197 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-631d5b72-dc5d-4c75-95a0-fbc4fa4ae60d tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:32.114197 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-631d5b72-dc5d-4c75-95a0-fbc4fa4ae60d tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:32.114197 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-631d5b72-dc5d-4c75-95a0-fbc4fa4ae60d tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:32.157890 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell1:SELECT=43 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:27:32.205375 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.quota [None req-074f2085-c522-49bc-9368-b60a5974e116 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Getting quotas for project e8603a3b1604479da86224c52c2467ad. Resources: {'instances', 'cores', 'ram'} {{(pid=118624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:27:32.211026 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.quota [None req-074f2085-c522-49bc-9368-b60a5974e116 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Getting quotas for user 76baaf45903d4c53ab3e0fe459b228ea and project e8603a3b1604479da86224c52c2467ad. Resources: {'instances', 'cores', 'ram'} {{(pid=118624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:27:32.253487 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-074f2085-c522-49bc-9368-b60a5974e116 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Going to run 1 instances... {{(pid=118624) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 18:27:32.258317 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-074f2085-c522-49bc-9368-b60a5974e116 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e2555120-8576-4128-944f-40805aa95a9b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118624) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 18:27:32.496460 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-631d5b72-dc5d-4c75-95a0-fbc4fa4ae60d tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419d0cc6ca7e426cb28257b32037901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea8b1ec08d6485ab1ac360549789d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:32.507591 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-631d5b72-dc5d-4c75-95a0-fbc4fa4ae60d tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] 10.222.0.78 "GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd" status: 200 len: 1314 microversion: 2.1 time: 0.413078 Jun 14 18:27:32.512378 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 20/50] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:32 2022] GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:32.561573 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-3e0359bd-bafc-4af6-92e4-6b1deb40e40f tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:32.561573 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-3e0359bd-bafc-4af6-92e4-6b1deb40e40f tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:32.623860 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-074f2085-c522-49bc-9368-b60a5974e116 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.150934 Jun 14 18:27:32.632022 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 31/51] 10.222.0.78 () {62 vars in 1187 bytes} [Tue Jun 14 18:27:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 3160 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 14 18:27:32.644236 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-a17fd98d-5e97-4c9f-90c0-a9795ae9bc94 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:32.645370 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-a17fd98d-5e97-4c9f-90c0-a9795ae9bc94 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:32.670330 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-3e0359bd-bafc-4af6-92e4-6b1deb40e40f tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:32.680734 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-3e0359bd-bafc-4af6-92e4-6b1deb40e40f tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1221 microversion: 2.1 time: 0.155525 Jun 14 18:27:32.681480 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 21/52] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:32 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1221 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:32.845275 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-a17fd98d-5e97-4c9f-90c0-a9795ae9bc94 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:32.874928 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-a17fd98d-5e97-4c9f-90c0-a9795ae9bc94 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:32.882286 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-a17fd98d-5e97-4c9f-90c0-a9795ae9bc94 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:32.887015 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-a17fd98d-5e97-4c9f-90c0-a9795ae9bc94 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1280 microversion: 2.20 time: 0.248015 Jun 14 18:27:32.891512 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 32/53] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:27:32 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1280 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:27:33.542868 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-b8e785ee-0e69-4e9a-9abd-d5f1e72ac515 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:33.543702 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-b8e785ee-0e69-4e9a-9abd-d5f1e72ac515 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] [instance: 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:33.552075 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b8e785ee-0e69-4e9a-9abd-d5f1e72ac515 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:33.552542 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b8e785ee-0e69-4e9a-9abd-d5f1e72ac515 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:33.553300 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b8e785ee-0e69-4e9a-9abd-d5f1e72ac515 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:33.555783 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b8e785ee-0e69-4e9a-9abd-d5f1e72ac515 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:33.699547 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-761d1aee-d58c-4e9b-9d84-d17d38070561 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:33.701555 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-761d1aee-d58c-4e9b-9d84-d17d38070561 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:33.711664 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-761d1aee-d58c-4e9b-9d84-d17d38070561 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:33.712551 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-761d1aee-d58c-4e9b-9d84-d17d38070561 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:33.714082 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-761d1aee-d58c-4e9b-9d84-d17d38070561 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:33.714687 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-761d1aee-d58c-4e9b-9d84-d17d38070561 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:33.748881 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-b8e785ee-0e69-4e9a-9abd-d5f1e72ac515 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419d0cc6ca7e426cb28257b32037901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea8b1ec08d6485ab1ac360549789d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:33.757587 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-b8e785ee-0e69-4e9a-9abd-d5f1e72ac515 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] 10.222.0.78 "GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd" status: 200 len: 1314 microversion: 2.1 time: 0.220311 Jun 14 18:27:33.758466 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 22/54] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:33 2022] GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:33.876437 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-761d1aee-d58c-4e9b-9d84-d17d38070561 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:33.890149 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-761d1aee-d58c-4e9b-9d84-d17d38070561 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1225 microversion: 2.1 time: 0.195352 Jun 14 18:27:33.897999 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 33/55] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:33 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1225 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:33.911651 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-a4631222-4994-4edd-8c04-5c76593ec978 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:33.912277 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-a4631222-4994-4edd-8c04-5c76593ec978 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:33.996269 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-a4631222-4994-4edd-8c04-5c76593ec978 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:34.002100 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-a4631222-4994-4edd-8c04-5c76593ec978 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:34.004395 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-a4631222-4994-4edd-8c04-5c76593ec978 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:34.006032 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-a4631222-4994-4edd-8c04-5c76593ec978 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1280 microversion: 2.20 time: 0.100813 Jun 14 18:27:34.010028 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 23/56] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:27:33 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1280 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:27:34.602009 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-095266a7-91f8-4470-820c-ac301b6c677a tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1761924804", "imageRef": "e2555120-8576-4128-944f-40805aa95a9b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c02f9f85-b95f-4513-a67b-ed0864c5046e"}], "security_groups": [{"name": "tempest-securitygroup--1982696763"}], "key_name": "tempest-keypair-1626601001", "user_data": "}} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:27:34.762736 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.network.neutron [None req-095266a7-91f8-4470-820c-ac301b6c677a tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] validate_networks() for [('c02f9f85-b95f-4513-a67b-ed0864c5046e', None, None, None, None, None)] {{(pid=118624) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 18:27:34.783812 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-c49ab3f5-82b6-4390-8e4b-a980675ec7e1 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:34.784437 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-c49ab3f5-82b6-4390-8e4b-a980675ec7e1 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] [instance: 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:34.795205 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c49ab3f5-82b6-4390-8e4b-a980675ec7e1 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:34.795664 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c49ab3f5-82b6-4390-8e4b-a980675ec7e1 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:34.797935 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c49ab3f5-82b6-4390-8e4b-a980675ec7e1 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:34.799266 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c49ab3f5-82b6-4390-8e4b-a980675ec7e1 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:35.117139 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-c49ab3f5-82b6-4390-8e4b-a980675ec7e1 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419d0cc6ca7e426cb28257b32037901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea8b1ec08d6485ab1ac360549789d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:35.125398 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-c49ab3f5-82b6-4390-8e4b-a980675ec7e1 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] 10.222.0.78 "GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd" status: 200 len: 1314 microversion: 2.1 time: 0.353244 Jun 14 18:27:35.134886 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 24/57] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:34 2022] GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:35.140521 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-ffcfabf0-9e5f-45ac-9040-99c99d9e5d32 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:35.141298 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-ffcfabf0-9e5f-45ac-9040-99c99d9e5d32 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:35.149139 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ffcfabf0-9e5f-45ac-9040-99c99d9e5d32 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:35.149906 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ffcfabf0-9e5f-45ac-9040-99c99d9e5d32 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:35.150850 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ffcfabf0-9e5f-45ac-9040-99c99d9e5d32 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:35.151982 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ffcfabf0-9e5f-45ac-9040-99c99d9e5d32 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:35.217720 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-ffcfabf0-9e5f-45ac-9040-99c99d9e5d32 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:35.230190 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-ffcfabf0-9e5f-45ac-9040-99c99d9e5d32 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1225 microversion: 2.1 time: 0.089251 Jun 14 18:27:35.230190 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 25/58] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:35 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:35.233224 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-71e9262b-dbde-455b-840d-a08df74c639e tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:35.234614 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-71e9262b-dbde-455b-840d-a08df74c639e tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:35.242489 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-71e9262b-dbde-455b-840d-a08df74c639e tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:35.242970 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-71e9262b-dbde-455b-840d-a08df74c639e tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:35.243800 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-71e9262b-dbde-455b-840d-a08df74c639e tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:35.244186 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-71e9262b-dbde-455b-840d-a08df74c639e tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:35.274233 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-095266a7-91f8-4470-820c-ac301b6c677a tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Flavor limits 0:0:0 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 18:27:35.275090 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-095266a7-91f8-4470-820c-ac301b6c677a tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Image limits 0:0:0 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 18:27:35.275643 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-095266a7-91f8-4470-820c-ac301b6c677a tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Flavor pref 0:0:0 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 18:27:35.276222 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-095266a7-91f8-4470-820c-ac301b6c677a tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Image pref 0:0:0 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 18:27:35.277642 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-095266a7-91f8-4470-820c-ac301b6c677a tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 18:27:35.287581 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-095266a7-91f8-4470-820c-ac301b6c677a tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:35.288126 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-095266a7-91f8-4470-820c-ac301b6c677a tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:35.288929 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-095266a7-91f8-4470-820c-ac301b6c677a tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:35.289369 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-095266a7-91f8-4470-820c-ac301b6c677a tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:35.307047 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.quota [None req-095266a7-91f8-4470-820c-ac301b6c677a tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Getting quotas for project e2f771a602054b349adae092a9d3ed24. Resources: {'instances', 'cores', 'ram'} {{(pid=118624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:27:35.311253 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.quota [None req-095266a7-91f8-4470-820c-ac301b6c677a tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Getting quotas for user 922fd1f30c7647fdb19f8f67a39223cc and project e2f771a602054b349adae092a9d3ed24. Resources: {'instances', 'cores', 'ram'} {{(pid=118624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:27:35.322494 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-095266a7-91f8-4470-820c-ac301b6c677a tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Going to run 1 instances... {{(pid=118624) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 18:27:35.324731 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-095266a7-91f8-4470-820c-ac301b6c677a tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e2555120-8576-4128-944f-40805aa95a9b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118624) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 18:27:35.360652 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-71e9262b-dbde-455b-840d-a08df74c639e tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:35.374701 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-71e9262b-dbde-455b-840d-a08df74c639e tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:35.376231 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-71e9262b-dbde-455b-840d-a08df74c639e tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:35.377439 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-71e9262b-dbde-455b-840d-a08df74c639e tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1284 microversion: 2.20 time: 0.149836 Jun 14 18:27:35.393933 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 26/59] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:27:35 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1284 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:27:35.478890 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-095266a7-91f8-4470-820c-ac301b6c677a tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.884070 Jun 14 18:27:35.487077 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 34/60] 10.222.0.78 () {60 vars in 1146 bytes} [Tue Jun 14 18:27:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 18:27:35.492424 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-c5a8bd5b-b4fc-46d6-b066-5a09de1099bb tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:35.496731 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-c5a8bd5b-b4fc-46d6-b066-5a09de1099bb tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:35.565222 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-c5a8bd5b-b4fc-46d6-b066-5a09de1099bb tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:35.571991 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-c5a8bd5b-b4fc-46d6-b066-5a09de1099bb tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1238 microversion: 2.1 time: 0.085335 Jun 14 18:27:35.585925 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 27/61] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:35 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1238 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:27:36.143653 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-bded02ce-f5a4-4903-a52b-71f68ae8998f tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:36.144273 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-bded02ce-f5a4-4903-a52b-71f68ae8998f tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] [instance: 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:36.150535 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-bded02ce-f5a4-4903-a52b-71f68ae8998f tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:36.150989 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-bded02ce-f5a4-4903-a52b-71f68ae8998f tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:36.153240 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-bded02ce-f5a4-4903-a52b-71f68ae8998f tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:36.153240 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-bded02ce-f5a4-4903-a52b-71f68ae8998f tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:36.243075 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-c2adfa0e-d241-45d7-8c41-bff2fe8ffdcb tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:36.243722 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-c2adfa0e-d241-45d7-8c41-bff2fe8ffdcb tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:36.251404 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c2adfa0e-d241-45d7-8c41-bff2fe8ffdcb tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:36.251860 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c2adfa0e-d241-45d7-8c41-bff2fe8ffdcb tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:36.252637 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c2adfa0e-d241-45d7-8c41-bff2fe8ffdcb tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:36.253085 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c2adfa0e-d241-45d7-8c41-bff2fe8ffdcb tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:36.305249 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-bded02ce-f5a4-4903-a52b-71f68ae8998f tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419d0cc6ca7e426cb28257b32037901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea8b1ec08d6485ab1ac360549789d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:36.308836 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-bded02ce-f5a4-4903-a52b-71f68ae8998f tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] 10.222.0.78 "GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd" status: 200 len: 1314 microversion: 2.1 time: 0.168392 Jun 14 18:27:36.310246 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 35/62] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:36 2022] GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:36.332652 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-c2adfa0e-d241-45d7-8c41-bff2fe8ffdcb tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:36.340342 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-c2adfa0e-d241-45d7-8c41-bff2fe8ffdcb tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1225 microversion: 2.1 time: 0.101396 Jun 14 18:27:36.342602 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 28/63] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:36 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:27:36.402582 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-2ea24e1e-4ef8-427e-bb59-654731bdbed6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:36.403239 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-2ea24e1e-4ef8-427e-bb59-654731bdbed6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:36.414056 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2ea24e1e-4ef8-427e-bb59-654731bdbed6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:36.414533 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2ea24e1e-4ef8-427e-bb59-654731bdbed6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:36.415326 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2ea24e1e-4ef8-427e-bb59-654731bdbed6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:36.415768 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2ea24e1e-4ef8-427e-bb59-654731bdbed6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:36.483645 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-2ea24e1e-4ef8-427e-bb59-654731bdbed6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:36.491733 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-2ea24e1e-4ef8-427e-bb59-654731bdbed6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:36.493259 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-2ea24e1e-4ef8-427e-bb59-654731bdbed6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:36.494410 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-2ea24e1e-4ef8-427e-bb59-654731bdbed6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1284 microversion: 2.20 time: 0.096715 Jun 14 18:27:36.496013 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 36/64] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:27:36 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:27:36.592695 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-2ff1e869-547d-4d17-9813-d9bc769b5ca7 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:36.593313 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-2ff1e869-547d-4d17-9813-d9bc769b5ca7 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:36.650770 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-2ff1e869-547d-4d17-9813-d9bc769b5ca7 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:36.658684 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-2ff1e869-547d-4d17-9813-d9bc769b5ca7 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1238 microversion: 2.1 time: 0.070836 Jun 14 18:27:36.659259 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 29/65] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:36 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1238 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:37.330745 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-32ffe0c3-4480-4a6a-b0b4-003479f844c5 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:37.340200 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-32ffe0c3-4480-4a6a-b0b4-003479f844c5 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] [instance: 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:37.353010 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-32ffe0c3-4480-4a6a-b0b4-003479f844c5 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:37.353010 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-32ffe0c3-4480-4a6a-b0b4-003479f844c5 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:37.353010 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-32ffe0c3-4480-4a6a-b0b4-003479f844c5 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:37.353010 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-32ffe0c3-4480-4a6a-b0b4-003479f844c5 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:37.363220 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-a56cc524-d0bf-4c6a-b75f-32d26bc45408 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:37.363786 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-a56cc524-d0bf-4c6a-b75f-32d26bc45408 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:37.375713 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a56cc524-d0bf-4c6a-b75f-32d26bc45408 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:37.376170 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a56cc524-d0bf-4c6a-b75f-32d26bc45408 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:37.377099 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a56cc524-d0bf-4c6a-b75f-32d26bc45408 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:37.377977 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a56cc524-d0bf-4c6a-b75f-32d26bc45408 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:37.573853 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-a56cc524-d0bf-4c6a-b75f-32d26bc45408 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:37.607492 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-a56cc524-d0bf-4c6a-b75f-32d26bc45408 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1225 microversion: 2.1 time: 0.247134 Jun 14 18:27:37.610465 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 30/66] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:37 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1225 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:37.629650 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-95659dbf-0790-453d-a101-e0f45104a386 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:37.630790 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-95659dbf-0790-453d-a101-e0f45104a386 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:37.654537 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-95659dbf-0790-453d-a101-e0f45104a386 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:37.654683 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-32ffe0c3-4480-4a6a-b0b4-003479f844c5 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419d0cc6ca7e426cb28257b32037901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea8b1ec08d6485ab1ac360549789d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:37.656195 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-95659dbf-0790-453d-a101-e0f45104a386 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:37.660662 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-95659dbf-0790-453d-a101-e0f45104a386 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:37.661919 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-95659dbf-0790-453d-a101-e0f45104a386 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:37.672055 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-32ffe0c3-4480-4a6a-b0b4-003479f844c5 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] 10.222.0.78 "GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd" status: 200 len: 1314 microversion: 2.1 time: 0.345235 Jun 14 18:27:37.676042 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 37/67] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:37 2022] GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:37.694866 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-8074231b-2fb5-48d2-8446-903194024806 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:37.699163 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-8074231b-2fb5-48d2-8446-903194024806 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:37.724286 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8074231b-2fb5-48d2-8446-903194024806 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:37.726051 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8074231b-2fb5-48d2-8446-903194024806 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:37.726944 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8074231b-2fb5-48d2-8446-903194024806 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:37.727427 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8074231b-2fb5-48d2-8446-903194024806 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:37.845840 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-8074231b-2fb5-48d2-8446-903194024806 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:37.860457 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-8074231b-2fb5-48d2-8446-903194024806 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1234 microversion: 2.1 time: 0.181866 Jun 14 18:27:37.871383 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 38/68] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:37 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1234 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:37.879756 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-95659dbf-0790-453d-a101-e0f45104a386 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:37.893191 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-95659dbf-0790-453d-a101-e0f45104a386 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:37.896172 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-95659dbf-0790-453d-a101-e0f45104a386 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:37.897903 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-95659dbf-0790-453d-a101-e0f45104a386 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1276 microversion: 2.20 time: 0.285475 Jun 14 18:27:37.901372 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 31/69] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:27:37 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1276 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:27:38.626241 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-47968986-1ebd-4cad-a36a-dbcbc7d1d7c8 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:38.626746 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-47968986-1ebd-4cad-a36a-dbcbc7d1d7c8 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:38.645151 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-47968986-1ebd-4cad-a36a-dbcbc7d1d7c8 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:38.645861 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-47968986-1ebd-4cad-a36a-dbcbc7d1d7c8 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:38.646968 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-47968986-1ebd-4cad-a36a-dbcbc7d1d7c8 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:38.647532 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-47968986-1ebd-4cad-a36a-dbcbc7d1d7c8 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:38.691320 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-5a485e71-926c-40b8-b8de-affb8b1c1fb8 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:38.692090 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-5a485e71-926c-40b8-b8de-affb8b1c1fb8 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] [instance: 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:38.702547 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5a485e71-926c-40b8-b8de-affb8b1c1fb8 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:38.703017 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5a485e71-926c-40b8-b8de-affb8b1c1fb8 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:38.703825 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5a485e71-926c-40b8-b8de-affb8b1c1fb8 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:38.720995 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5a485e71-926c-40b8-b8de-affb8b1c1fb8 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:38.854718 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-47968986-1ebd-4cad-a36a-dbcbc7d1d7c8 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:38.862870 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-47968986-1ebd-4cad-a36a-dbcbc7d1d7c8 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1273 microversion: 2.1 time: 0.240973 Jun 14 18:27:38.864157 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 39/70] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:38 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1273 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:27:38.880889 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-410b2e28-b15a-4d29-876b-8a4699423269 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:38.881099 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-410b2e28-b15a-4d29-876b-8a4699423269 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:38.888622 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-410b2e28-b15a-4d29-876b-8a4699423269 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:38.889283 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-410b2e28-b15a-4d29-876b-8a4699423269 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:38.890255 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-410b2e28-b15a-4d29-876b-8a4699423269 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:38.891051 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-410b2e28-b15a-4d29-876b-8a4699423269 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:39.102326 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-5a485e71-926c-40b8-b8de-affb8b1c1fb8 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419d0cc6ca7e426cb28257b32037901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea8b1ec08d6485ab1ac360549789d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:39.111882 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-5a485e71-926c-40b8-b8de-affb8b1c1fb8 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] 10.222.0.78 "GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd" status: 200 len: 1314 microversion: 2.1 time: 0.426215 Jun 14 18:27:39.114756 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 32/71] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:38 2022] GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd => generated 1314 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:39.128176 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-389e5e64-de95-4270-a00b-311f6a0858d4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:39.129112 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-389e5e64-de95-4270-a00b-311f6a0858d4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:39.143363 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-389e5e64-de95-4270-a00b-311f6a0858d4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:39.143728 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-389e5e64-de95-4270-a00b-311f6a0858d4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:39.147225 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-389e5e64-de95-4270-a00b-311f6a0858d4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:39.147991 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-389e5e64-de95-4270-a00b-311f6a0858d4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:39.271786 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-410b2e28-b15a-4d29-876b-8a4699423269 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:39.295268 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-410b2e28-b15a-4d29-876b-8a4699423269 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1290 microversion: 2.1 time: 0.414141 Jun 14 18:27:39.301485 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 40/72] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:38 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1290 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:27:39.375244 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-389e5e64-de95-4270-a00b-311f6a0858d4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:39.388735 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-389e5e64-de95-4270-a00b-311f6a0858d4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:39.400174 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-389e5e64-de95-4270-a00b-311f6a0858d4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:39.406874 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-389e5e64-de95-4270-a00b-311f6a0858d4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1340 microversion: 2.20 time: 0.287028 Jun 14 18:27:39.407509 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 33/73] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:27:39 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1340 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:27:39.890978 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-ea08ddab-074a-48f1-a15e-40d93c241893 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:39.891577 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-ea08ddab-074a-48f1-a15e-40d93c241893 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:39.898540 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ea08ddab-074a-48f1-a15e-40d93c241893 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:39.898990 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ea08ddab-074a-48f1-a15e-40d93c241893 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:39.900050 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ea08ddab-074a-48f1-a15e-40d93c241893 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:39.900673 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ea08ddab-074a-48f1-a15e-40d93c241893 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:40.126358 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-ea08ddab-074a-48f1-a15e-40d93c241893 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:40.133750 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-3aee5e98-fa43-4107-9e28-50ed9ab1aca2 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:40.134589 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-3aee5e98-fa43-4107-9e28-50ed9ab1aca2 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] [instance: 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:40.140431 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-ea08ddab-074a-48f1-a15e-40d93c241893 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1291 microversion: 2.1 time: 0.254294 Jun 14 18:27:40.148858 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3aee5e98-fa43-4107-9e28-50ed9ab1aca2 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:40.149380 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3aee5e98-fa43-4107-9e28-50ed9ab1aca2 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:40.153724 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 41/74] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:39 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1291 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:40.159011 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3aee5e98-fa43-4107-9e28-50ed9ab1aca2 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:40.161553 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3aee5e98-fa43-4107-9e28-50ed9ab1aca2 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:40.329211 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-a5c4d64b-f5f0-4d55-9e34-01dbb1d9855a tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:40.329854 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-a5c4d64b-f5f0-4d55-9e34-01dbb1d9855a tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:40.339977 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a5c4d64b-f5f0-4d55-9e34-01dbb1d9855a tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:40.340593 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a5c4d64b-f5f0-4d55-9e34-01dbb1d9855a tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:40.345479 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a5c4d64b-f5f0-4d55-9e34-01dbb1d9855a tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:40.347511 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a5c4d64b-f5f0-4d55-9e34-01dbb1d9855a tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:40.506918 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-a5c4d64b-f5f0-4d55-9e34-01dbb1d9855a tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:40.519332 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-a5c4d64b-f5f0-4d55-9e34-01dbb1d9855a tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1296 microversion: 2.1 time: 0.195658 Jun 14 18:27:40.537604 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 42/75] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:40 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1296 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:27:40.546652 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-751b5e84-d946-4a18-b72a-6ceb6b030fc2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:40.550708 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-751b5e84-d946-4a18-b72a-6ceb6b030fc2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:40.564503 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-751b5e84-d946-4a18-b72a-6ceb6b030fc2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:40.567368 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-751b5e84-d946-4a18-b72a-6ceb6b030fc2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:40.571539 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-751b5e84-d946-4a18-b72a-6ceb6b030fc2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:40.571539 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-751b5e84-d946-4a18-b72a-6ceb6b030fc2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:40.791059 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-3aee5e98-fa43-4107-9e28-50ed9ab1aca2 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419d0cc6ca7e426cb28257b32037901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea8b1ec08d6485ab1ac360549789d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:40.826068 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-3aee5e98-fa43-4107-9e28-50ed9ab1aca2 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] 10.222.0.78 "GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd" status: 200 len: 1314 microversion: 2.1 time: 0.697916 Jun 14 18:27:40.840702 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 34/76] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:40 2022] GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd => generated 1314 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:40.840702 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-2c0a1206-b931-46f1-8fcd-a77ea3796382 req-1ed0a4ac-a13b-4812-9cd7-b2389012cc25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99045096-d6ff-4e14-b710-1b1e2dd9a7c5", "tag": "3f0e5739-b788-43f3-8405-75ad4766a788"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:27:40.880791 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-2c0a1206-b931-46f1-8fcd-a77ea3796382 req-1ed0a4ac-a13b-4812-9cd7-b2389012cc25 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:40.880791 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-2c0a1206-b931-46f1-8fcd-a77ea3796382 req-1ed0a4ac-a13b-4812-9cd7-b2389012cc25 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:40.909038 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-2c0a1206-b931-46f1-8fcd-a77ea3796382 req-1ed0a4ac-a13b-4812-9cd7-b2389012cc25 service nova] Creating event network-changed:3f0e5739-b788-43f3-8405-75ad4766a788 for instance 99045096-d6ff-4e14-b710-1b1e2dd9a7c5 on hv-cinder-84456 Jun 14 18:27:40.916050 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-2c0a1206-b931-46f1-8fcd-a77ea3796382 req-1ed0a4ac-a13b-4812-9cd7-b2389012cc25 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083390 Jun 14 18:27:40.919194 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 35/77] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:27:40.958649 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-751b5e84-d946-4a18-b72a-6ceb6b030fc2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:40.974590 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-751b5e84-d946-4a18-b72a-6ceb6b030fc2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:40.976579 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-751b5e84-d946-4a18-b72a-6ceb6b030fc2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:40.978087 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-751b5e84-d946-4a18-b72a-6ceb6b030fc2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1338 microversion: 2.20 time: 0.439249 Jun 14 18:27:40.978890 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 43/78] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:27:40 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1338 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:27:41.161244 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-9afbdae3-3f4b-4693-9e25-46c92704b220 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:41.162579 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-9afbdae3-3f4b-4693-9e25-46c92704b220 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:41.180293 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9afbdae3-3f4b-4693-9e25-46c92704b220 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:41.180293 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9afbdae3-3f4b-4693-9e25-46c92704b220 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:41.180293 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9afbdae3-3f4b-4693-9e25-46c92704b220 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:41.180293 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9afbdae3-3f4b-4693-9e25-46c92704b220 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:41.404712 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-62e23ce4-f935-4832-a3f9-ae3b98f430e3 req-d9b051ff-7116-41dc-9f50-9da0a4f2c522 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd", "name": "network-vif-plugged", "status": "completed", "tag": "1de4fd5a-d3c5-41de-a140-a242d715583a"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:27:41.428093 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-62e23ce4-f935-4832-a3f9-ae3b98f430e3 req-d9b051ff-7116-41dc-9f50-9da0a4f2c522 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:41.428930 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-62e23ce4-f935-4832-a3f9-ae3b98f430e3 req-d9b051ff-7116-41dc-9f50-9da0a4f2c522 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:41.452621 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-62e23ce4-f935-4832-a3f9-ae3b98f430e3 req-d9b051ff-7116-41dc-9f50-9da0a4f2c522 service nova] Creating event network-vif-plugged:1de4fd5a-d3c5-41de-a140-a242d715583a for instance 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd on hv-cinder-84456 Jun 14 18:27:41.453747 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-62e23ce4-f935-4832-a3f9-ae3b98f430e3 req-d9b051ff-7116-41dc-9f50-9da0a4f2c522 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118624) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 14 18:27:41.455079 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-0173e0f3-8adf-4e01-a6b2-74b0e5f94e68 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:41.455679 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-0173e0f3-8adf-4e01-a6b2-74b0e5f94e68 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:41.456477 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-0173e0f3-8adf-4e01-a6b2-74b0e5f94e68 None None] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:41.456914 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-0173e0f3-8adf-4e01-a6b2-74b0e5f94e68 None None] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:41.468227 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.compute.rpcapi [None req-0173e0f3-8adf-4e01-a6b2-74b0e5f94e68 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 14 18:27:41.469281 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-0173e0f3-8adf-4e01-a6b2-74b0e5f94e68 None None] Releasing lock "compute-rpcapi-router" {{(pid=118624) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 14 18:27:41.502938 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-0173e0f3-8adf-4e01-a6b2-74b0e5f94e68 None None] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.211557 Jun 14 18:27:41.504690 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 44/79] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:27:41.561732 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-aa53cd11-b0dc-49cd-900d-26c4f43d464f tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:41.562693 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-aa53cd11-b0dc-49cd-900d-26c4f43d464f tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:41.569801 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-aa53cd11-b0dc-49cd-900d-26c4f43d464f tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:41.578288 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-aa53cd11-b0dc-49cd-900d-26c4f43d464f tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:41.580981 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-aa53cd11-b0dc-49cd-900d-26c4f43d464f tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:41.580981 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-aa53cd11-b0dc-49cd-900d-26c4f43d464f tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:41.706668 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell0:SELECT=6 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:27:41.861491 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-9afbdae3-3f4b-4693-9e25-46c92704b220 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:41.876059 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-9afbdae3-3f4b-4693-9e25-46c92704b220 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1321 microversion: 2.1 time: 0.720005 Jun 14 18:27:41.885905 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 36/80] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:41 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1321 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:41.891709 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-a00f7191-6fca-434d-ad9d-d118fbfb3b9d tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:41.892596 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-a00f7191-6fca-434d-ad9d-d118fbfb3b9d tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] [instance: 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:41.900224 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a00f7191-6fca-434d-ad9d-d118fbfb3b9d tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:41.900900 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a00f7191-6fca-434d-ad9d-d118fbfb3b9d tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:41.902627 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a00f7191-6fca-434d-ad9d-d118fbfb3b9d tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:41.904450 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a00f7191-6fca-434d-ad9d-d118fbfb3b9d tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:41.916892 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-aa53cd11-b0dc-49cd-900d-26c4f43d464f tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:41.933673 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-aa53cd11-b0dc-49cd-900d-26c4f43d464f tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1296 microversion: 2.1 time: 0.388875 Jun 14 18:27:41.938631 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 45/81] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:41 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1296 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:42.002983 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-cf512a70-37f0-4ca0-b0bd-9c1052c2b60d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:42.005015 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-cf512a70-37f0-4ca0-b0bd-9c1052c2b60d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:42.015960 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-cf512a70-37f0-4ca0-b0bd-9c1052c2b60d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:42.017560 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-cf512a70-37f0-4ca0-b0bd-9c1052c2b60d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:42.022020 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-cf512a70-37f0-4ca0-b0bd-9c1052c2b60d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:42.022898 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-cf512a70-37f0-4ca0-b0bd-9c1052c2b60d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:42.284640 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-a00f7191-6fca-434d-ad9d-d118fbfb3b9d tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419d0cc6ca7e426cb28257b32037901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea8b1ec08d6485ab1ac360549789d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:42.301906 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-a00f7191-6fca-434d-ad9d-d118fbfb3b9d tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] 10.222.0.78 "GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd" status: 200 len: 1314 microversion: 2.1 time: 0.413995 Jun 14 18:27:42.317249 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 37/82] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:41 2022] GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:42.610239 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-cf512a70-37f0-4ca0-b0bd-9c1052c2b60d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:42.618484 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-cf512a70-37f0-4ca0-b0bd-9c1052c2b60d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:42.620711 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-cf512a70-37f0-4ca0-b0bd-9c1052c2b60d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:42.621852 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-cf512a70-37f0-4ca0-b0bd-9c1052c2b60d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1406 microversion: 2.20 time: 0.623353 Jun 14 18:27:42.632372 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 46/83] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:27:41 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1406 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:27:42.893311 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-baf9f5e9-1799-4207-8384-61c5c04f0da9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:42.893995 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-baf9f5e9-1799-4207-8384-61c5c04f0da9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:42.901937 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-baf9f5e9-1799-4207-8384-61c5c04f0da9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:42.902417 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-baf9f5e9-1799-4207-8384-61c5c04f0da9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:42.903357 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-baf9f5e9-1799-4207-8384-61c5c04f0da9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:42.903792 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-baf9f5e9-1799-4207-8384-61c5c04f0da9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:42.956190 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-ea4493cc-c7a2-4085-b0dc-c53e415d1017 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:42.956806 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-ea4493cc-c7a2-4085-b0dc-c53e415d1017 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:42.963011 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ea4493cc-c7a2-4085-b0dc-c53e415d1017 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:42.963461 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ea4493cc-c7a2-4085-b0dc-c53e415d1017 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:42.964242 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ea4493cc-c7a2-4085-b0dc-c53e415d1017 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:42.964675 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ea4493cc-c7a2-4085-b0dc-c53e415d1017 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:43.105234 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-baf9f5e9-1799-4207-8384-61c5c04f0da9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:43.116079 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-ea4493cc-c7a2-4085-b0dc-c53e415d1017 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:43.120027 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-baf9f5e9-1799-4207-8384-61c5c04f0da9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1321 microversion: 2.1 time: 0.230489 Jun 14 18:27:43.121737 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 38/84] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:42 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:43.124892 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-ea4493cc-c7a2-4085-b0dc-c53e415d1017 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1364 microversion: 2.1 time: 0.173092 Jun 14 18:27:43.134455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 47/85] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:42 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:43.344933 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-c1ab20c2-f4f5-42e3-a205-a1429026ebaf tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:43.345814 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-c1ab20c2-f4f5-42e3-a205-a1429026ebaf tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] [instance: 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:43.352902 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c1ab20c2-f4f5-42e3-a205-a1429026ebaf tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:43.353579 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c1ab20c2-f4f5-42e3-a205-a1429026ebaf tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:43.355164 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c1ab20c2-f4f5-42e3-a205-a1429026ebaf tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:43.355787 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c1ab20c2-f4f5-42e3-a205-a1429026ebaf tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:43.642315 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-d20cce3e-11a3-4383-b1d1-6e99a2f71495 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:43.642928 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-d20cce3e-11a3-4383-b1d1-6e99a2f71495 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:43.664589 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-c1ab20c2-f4f5-42e3-a205-a1429026ebaf tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419d0cc6ca7e426cb28257b32037901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea8b1ec08d6485ab1ac360549789d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:43.669015 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d20cce3e-11a3-4383-b1d1-6e99a2f71495 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:43.671127 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d20cce3e-11a3-4383-b1d1-6e99a2f71495 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:43.672201 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d20cce3e-11a3-4383-b1d1-6e99a2f71495 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:43.672786 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d20cce3e-11a3-4383-b1d1-6e99a2f71495 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:43.674634 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-c1ab20c2-f4f5-42e3-a205-a1429026ebaf tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] 10.222.0.78 "GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd" status: 200 len: 1314 microversion: 2.1 time: 0.333698 Jun 14 18:27:43.688654 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 39/86] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:43 2022] GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:27:44.141615 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-737c1f1e-5e60-492e-91ff-2f2b1d594164 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:44.142469 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-737c1f1e-5e60-492e-91ff-2f2b1d594164 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:44.157517 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-737c1f1e-5e60-492e-91ff-2f2b1d594164 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:44.158140 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-737c1f1e-5e60-492e-91ff-2f2b1d594164 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:44.158800 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-737c1f1e-5e60-492e-91ff-2f2b1d594164 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:44.159242 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-737c1f1e-5e60-492e-91ff-2f2b1d594164 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:44.785535 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-737c1f1e-5e60-492e-91ff-2f2b1d594164 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:44.795394 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-737c1f1e-5e60-492e-91ff-2f2b1d594164 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1321 microversion: 2.1 time: 0.658311 Jun 14 18:27:44.796290 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 40/87] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:44 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1321 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:44.802289 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-d20cce3e-11a3-4383-b1d1-6e99a2f71495 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:44.812359 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-d20cce3e-11a3-4383-b1d1-6e99a2f71495 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:44.815449 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-6b7739f5-0651-40e2-b91a-2c676b29022a tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:44.816061 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-6b7739f5-0651-40e2-b91a-2c676b29022a tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:44.818211 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-d20cce3e-11a3-4383-b1d1-6e99a2f71495 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:44.819825 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-d20cce3e-11a3-4383-b1d1-6e99a2f71495 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1406 microversion: 2.20 time: 1.181426 Jun 14 18:27:44.824556 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6b7739f5-0651-40e2-b91a-2c676b29022a tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:44.829602 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6b7739f5-0651-40e2-b91a-2c676b29022a tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:44.829602 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6b7739f5-0651-40e2-b91a-2c676b29022a tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:44.829602 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6b7739f5-0651-40e2-b91a-2c676b29022a tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:44.830885 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 48/88] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:27:43 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1406 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:27:44.832178 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell1:SELECT=100 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:27:44.924599 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-191e4df8-ca4e-429e-9d52-aa49fef41940 req-1dc1e8d5-1f90-4ad8-9c16-7d0c622fb6c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2876875b-5dbe-4032-949a-3357292296a2", "tag": "ee384335-560e-4f82-a137-0b23b61ff825"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:27:44.943715 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-191e4df8-ca4e-429e-9d52-aa49fef41940 req-1dc1e8d5-1f90-4ad8-9c16-7d0c622fb6c7 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:44.946298 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-191e4df8-ca4e-429e-9d52-aa49fef41940 req-1dc1e8d5-1f90-4ad8-9c16-7d0c622fb6c7 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:44.980444 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-191e4df8-ca4e-429e-9d52-aa49fef41940 req-1dc1e8d5-1f90-4ad8-9c16-7d0c622fb6c7 service nova] Creating event network-changed:ee384335-560e-4f82-a137-0b23b61ff825 for instance 2876875b-5dbe-4032-949a-3357292296a2 on hv-cinder-84456 Jun 14 18:27:44.998348 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-191e4df8-ca4e-429e-9d52-aa49fef41940 req-1dc1e8d5-1f90-4ad8-9c16-7d0c622fb6c7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164412 Jun 14 18:27:45.000827 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 49/89] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:27:45.013672 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-0e0ba872-60aa-4bb3-982d-1861b5ac2895 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:45.015491 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-0e0ba872-60aa-4bb3-982d-1861b5ac2895 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] [instance: 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:45.028206 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-0e0ba872-60aa-4bb3-982d-1861b5ac2895 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:45.028918 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-0e0ba872-60aa-4bb3-982d-1861b5ac2895 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:45.030695 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-0e0ba872-60aa-4bb3-982d-1861b5ac2895 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:45.030695 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-0e0ba872-60aa-4bb3-982d-1861b5ac2895 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:45.228016 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-6b7739f5-0651-40e2-b91a-2c676b29022a tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:45.241226 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-6b7739f5-0651-40e2-b91a-2c676b29022a tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1364 microversion: 2.1 time: 0.443702 Jun 14 18:27:45.242134 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 41/90] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:44 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1364 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:45.259945 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-7058c0ad-5a52-433f-a0ae-4837eb89638c req-108453a2-4378-4ada-af51-e79c9b7ae82b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90a63d77-87d7-4616-af3d-fe6cb12e93fe", "tag": "7513d78b-6877-4846-a318-fbe800a362f4"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:27:45.270179 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-7058c0ad-5a52-433f-a0ae-4837eb89638c req-108453a2-4378-4ada-af51-e79c9b7ae82b service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:45.270382 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-0e0ba872-60aa-4bb3-982d-1861b5ac2895 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419d0cc6ca7e426cb28257b32037901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea8b1ec08d6485ab1ac360549789d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:45.271004 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-7058c0ad-5a52-433f-a0ae-4837eb89638c req-108453a2-4378-4ada-af51-e79c9b7ae82b service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:45.281322 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-0e0ba872-60aa-4bb3-982d-1861b5ac2895 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] 10.222.0.78 "GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd" status: 200 len: 1314 microversion: 2.1 time: 0.276733 Jun 14 18:27:45.285958 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 50/91] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:45 2022] GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:45.297503 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-7058c0ad-5a52-433f-a0ae-4837eb89638c req-108453a2-4378-4ada-af51-e79c9b7ae82b service nova] Creating event network-changed:7513d78b-6877-4846-a318-fbe800a362f4 for instance 90a63d77-87d7-4616-af3d-fe6cb12e93fe on hv-cinder-84456 Jun 14 18:27:45.303330 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-7058c0ad-5a52-433f-a0ae-4837eb89638c req-108453a2-4378-4ada-af51-e79c9b7ae82b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047044 Jun 14 18:27:45.304120 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 42/92] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:27:45.809750 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell0:SELECT=22 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:27:45.813888 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-f3442add-aa88-49af-8517-92adb6ab8075 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:45.814681 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-f3442add-aa88-49af-8517-92adb6ab8075 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:45.821055 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f3442add-aa88-49af-8517-92adb6ab8075 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:45.821967 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f3442add-aa88-49af-8517-92adb6ab8075 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:45.822782 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f3442add-aa88-49af-8517-92adb6ab8075 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:45.823952 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f3442add-aa88-49af-8517-92adb6ab8075 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:45.833667 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell1:SELECT=100 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:27:45.839124 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-9ad30b40-a5ce-4e79-801a-68384e9d00b9 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:45.840543 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-9ad30b40-a5ce-4e79-801a-68384e9d00b9 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:45.850317 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9ad30b40-a5ce-4e79-801a-68384e9d00b9 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:45.851783 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9ad30b40-a5ce-4e79-801a-68384e9d00b9 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:45.854071 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9ad30b40-a5ce-4e79-801a-68384e9d00b9 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:45.854536 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9ad30b40-a5ce-4e79-801a-68384e9d00b9 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:46.129823 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-f3442add-aa88-49af-8517-92adb6ab8075 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:46.139439 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-f3442add-aa88-49af-8517-92adb6ab8075 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1321 microversion: 2.1 time: 0.330641 Jun 14 18:27:46.140055 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 51/93] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:45 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1321 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:46.262766 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-1e1b9dbc-4ee6-4d13-bc5e-775a3a5b5780 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:46.263585 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-1e1b9dbc-4ee6-4d13-bc5e-775a3a5b5780 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:46.271364 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1e1b9dbc-4ee6-4d13-bc5e-775a3a5b5780 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:46.271829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1e1b9dbc-4ee6-4d13-bc5e-775a3a5b5780 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:46.272607 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1e1b9dbc-4ee6-4d13-bc5e-775a3a5b5780 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:46.273065 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1e1b9dbc-4ee6-4d13-bc5e-775a3a5b5780 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:46.349476 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-9ad30b40-a5ce-4e79-801a-68384e9d00b9 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:46.366355 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-9ad30b40-a5ce-4e79-801a-68384e9d00b9 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:46.368098 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-9ad30b40-a5ce-4e79-801a-68384e9d00b9 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:46.369537 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-9ad30b40-a5ce-4e79-801a-68384e9d00b9 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1406 microversion: 2.20 time: 0.534869 Jun 14 18:27:46.371707 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 43/94] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:27:45 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1406 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:27:46.376630 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-9adac98c-efc9-4a4e-afe0-28f2d5c86514 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:46.377518 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-9adac98c-efc9-4a4e-afe0-28f2d5c86514 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] [instance: 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:46.384115 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9adac98c-efc9-4a4e-afe0-28f2d5c86514 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:46.384790 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9adac98c-efc9-4a4e-afe0-28f2d5c86514 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:46.386249 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9adac98c-efc9-4a4e-afe0-28f2d5c86514 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:46.387140 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9adac98c-efc9-4a4e-afe0-28f2d5c86514 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:46.425353 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-1e1b9dbc-4ee6-4d13-bc5e-775a3a5b5780 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:46.433870 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-1e1b9dbc-4ee6-4d13-bc5e-775a3a5b5780 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1364 microversion: 2.1 time: 0.176818 Jun 14 18:27:46.443979 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 52/95] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:46 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1364 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:46.572830 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-9adac98c-efc9-4a4e-afe0-28f2d5c86514 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419d0cc6ca7e426cb28257b32037901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea8b1ec08d6485ab1ac360549789d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:46.582187 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-9adac98c-efc9-4a4e-afe0-28f2d5c86514 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] 10.222.0.78 "GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd" status: 200 len: 1500 microversion: 2.1 time: 0.209323 Jun 14 18:27:46.584359 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 44/96] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:46 2022] GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd => generated 1500 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:46.715299 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-d79dd43e-f953-4178-9872-5f1f9480655e req-ed43d8f2-7248-4ce3-9f09-812fc6792055 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99045096-d6ff-4e14-b710-1b1e2dd9a7c5", "name": "network-vif-plugged", "status": "completed", "tag": "3f0e5739-b788-43f3-8405-75ad4766a788"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:27:46.724025 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-d79dd43e-f953-4178-9872-5f1f9480655e req-ed43d8f2-7248-4ce3-9f09-812fc6792055 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:46.724661 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-d79dd43e-f953-4178-9872-5f1f9480655e req-ed43d8f2-7248-4ce3-9f09-812fc6792055 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:46.737506 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-d79dd43e-f953-4178-9872-5f1f9480655e req-ed43d8f2-7248-4ce3-9f09-812fc6792055 service nova] Creating event network-vif-plugged:3f0e5739-b788-43f3-8405-75ad4766a788 for instance 99045096-d6ff-4e14-b710-1b1e2dd9a7c5 on hv-cinder-84456 Jun 14 18:27:46.743213 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-d79dd43e-f953-4178-9872-5f1f9480655e req-ed43d8f2-7248-4ce3-9f09-812fc6792055 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031648 Jun 14 18:27:46.744329 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 53/97] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:27:47.014886 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-7c457277-ee75-459f-9a7a-2e925b1eaffc req-76497a79-378e-4995-a757-93506a2bca97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee", "tag": "dcaeaf29-4f8b-4d99-8c22-29b129b65a8c"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:27:47.020286 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell0:SELECT=22 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:27:47.024213 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-7c457277-ee75-459f-9a7a-2e925b1eaffc req-76497a79-378e-4995-a757-93506a2bca97 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:47.024651 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-7c457277-ee75-459f-9a7a-2e925b1eaffc req-76497a79-378e-4995-a757-93506a2bca97 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:47.037762 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-7c457277-ee75-459f-9a7a-2e925b1eaffc req-76497a79-378e-4995-a757-93506a2bca97 service nova] Creating event network-changed:dcaeaf29-4f8b-4d99-8c22-29b129b65a8c for instance 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee on hv-cinder-84456 Jun 14 18:27:47.043792 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-7c457277-ee75-459f-9a7a-2e925b1eaffc req-76497a79-378e-4995-a757-93506a2bca97 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033315 Jun 14 18:27:47.044398 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 45/98] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:27:47.158304 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-cd628029-d2dc-48ac-82db-a4c37c542d9a tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:47.159122 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-cd628029-d2dc-48ac-82db-a4c37c542d9a tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:47.168621 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-cd628029-d2dc-48ac-82db-a4c37c542d9a tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:47.169090 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-cd628029-d2dc-48ac-82db-a4c37c542d9a tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:47.170072 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-cd628029-d2dc-48ac-82db-a4c37c542d9a tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:47.173692 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-cd628029-d2dc-48ac-82db-a4c37c542d9a tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:47.306662 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-cd628029-d2dc-48ac-82db-a4c37c542d9a tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:47.328023 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-cd628029-d2dc-48ac-82db-a4c37c542d9a tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1321 microversion: 2.1 time: 0.175051 Jun 14 18:27:47.328621 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 54/99] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:47 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:27:47.389557 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-3b38208f-89d3-4dc0-85dc-410f494c2271 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:47.390316 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-3b38208f-89d3-4dc0-85dc-410f494c2271 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:47.397077 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3b38208f-89d3-4dc0-85dc-410f494c2271 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:47.397558 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3b38208f-89d3-4dc0-85dc-410f494c2271 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:47.398368 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3b38208f-89d3-4dc0-85dc-410f494c2271 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:47.398800 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3b38208f-89d3-4dc0-85dc-410f494c2271 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:47.451329 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-408f222c-9992-44f0-a375-6cb958a1ee1b tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:47.451940 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-408f222c-9992-44f0-a375-6cb958a1ee1b tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:47.470634 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-408f222c-9992-44f0-a375-6cb958a1ee1b tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:47.471080 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-408f222c-9992-44f0-a375-6cb958a1ee1b tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:47.471859 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-408f222c-9992-44f0-a375-6cb958a1ee1b tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:47.472295 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-408f222c-9992-44f0-a375-6cb958a1ee1b tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:47.643636 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-3b38208f-89d3-4dc0-85dc-410f494c2271 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:47.644424 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-408f222c-9992-44f0-a375-6cb958a1ee1b tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:47.652644 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-3b38208f-89d3-4dc0-85dc-410f494c2271 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:47.653342 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-408f222c-9992-44f0-a375-6cb958a1ee1b tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1364 microversion: 2.1 time: 0.206751 Jun 14 18:27:47.654189 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 55/100] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:47 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1364 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:27:47.654431 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-3b38208f-89d3-4dc0-85dc-410f494c2271 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:47.655532 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-3b38208f-89d3-4dc0-85dc-410f494c2271 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1406 microversion: 2.20 time: 0.271140 Jun 14 18:27:47.656071 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 46/101] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:27:47 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1406 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:27:48.343825 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-3d3cfcf5-1235-427d-acfb-11d08da1a6bd tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:48.344435 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-3d3cfcf5-1235-427d-acfb-11d08da1a6bd tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:48.352477 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3d3cfcf5-1235-427d-acfb-11d08da1a6bd tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:48.353160 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3d3cfcf5-1235-427d-acfb-11d08da1a6bd tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:48.354726 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3d3cfcf5-1235-427d-acfb-11d08da1a6bd tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:48.355335 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3d3cfcf5-1235-427d-acfb-11d08da1a6bd tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:48.504219 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-3d3cfcf5-1235-427d-acfb-11d08da1a6bd tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:48.511729 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-3d3cfcf5-1235-427d-acfb-11d08da1a6bd tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1321 microversion: 2.1 time: 0.171632 Jun 14 18:27:48.512314 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 56/102] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:48 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:48.672470 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-eddcd141-31ab-4859-880e-df86372e6707 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:48.673808 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-718e888d-ea50-475f-a889-c902939914dc tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:48.674080 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-eddcd141-31ab-4859-880e-df86372e6707 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:48.674416 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-718e888d-ea50-475f-a889-c902939914dc tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:48.680774 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-718e888d-ea50-475f-a889-c902939914dc tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:48.681221 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-718e888d-ea50-475f-a889-c902939914dc tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:48.682021 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-718e888d-ea50-475f-a889-c902939914dc tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:48.682516 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-718e888d-ea50-475f-a889-c902939914dc tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:48.683145 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-eddcd141-31ab-4859-880e-df86372e6707 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:48.683872 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-eddcd141-31ab-4859-880e-df86372e6707 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:48.685030 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-eddcd141-31ab-4859-880e-df86372e6707 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:48.685149 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-eddcd141-31ab-4859-880e-df86372e6707 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:48.831286 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-718e888d-ea50-475f-a889-c902939914dc tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:48.841847 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-718e888d-ea50-475f-a889-c902939914dc tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:48.845430 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-eddcd141-31ab-4859-880e-df86372e6707 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:48.853391 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-eddcd141-31ab-4859-880e-df86372e6707 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1364 microversion: 2.1 time: 0.185621 Jun 14 18:27:48.856147 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-718e888d-ea50-475f-a889-c902939914dc tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:48.868824 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 47/103] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:48 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1364 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:27:48.869303 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-718e888d-ea50-475f-a889-c902939914dc tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1406 microversion: 2.20 time: 0.187435 Jun 14 18:27:48.869303 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 57/104] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:27:48 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1406 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:27:49.528949 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-e01be36d-dd48-4602-a4b3-92480dd81bb6 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:49.529696 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-e01be36d-dd48-4602-a4b3-92480dd81bb6 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:49.537124 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e01be36d-dd48-4602-a4b3-92480dd81bb6 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:49.537712 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e01be36d-dd48-4602-a4b3-92480dd81bb6 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:49.538482 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e01be36d-dd48-4602-a4b3-92480dd81bb6 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:49.539034 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e01be36d-dd48-4602-a4b3-92480dd81bb6 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:49.685383 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-e01be36d-dd48-4602-a4b3-92480dd81bb6 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:49.693773 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-e01be36d-dd48-4602-a4b3-92480dd81bb6 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1321 microversion: 2.1 time: 0.169251 Jun 14 18:27:49.694351 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 48/105] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:49 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:49.876532 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-d3fcc302-9b38-43ef-ac5f-ca31a44f4f90 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:49.878202 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-d3fcc302-9b38-43ef-ac5f-ca31a44f4f90 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:49.879457 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-e1394219-8e0f-4702-ad33-fbf738204656 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:49.880171 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-e1394219-8e0f-4702-ad33-fbf738204656 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:49.888095 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e1394219-8e0f-4702-ad33-fbf738204656 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:49.888861 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e1394219-8e0f-4702-ad33-fbf738204656 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:49.890016 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e1394219-8e0f-4702-ad33-fbf738204656 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:49.890770 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e1394219-8e0f-4702-ad33-fbf738204656 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:49.904171 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d3fcc302-9b38-43ef-ac5f-ca31a44f4f90 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:49.904665 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d3fcc302-9b38-43ef-ac5f-ca31a44f4f90 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:49.905507 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d3fcc302-9b38-43ef-ac5f-ca31a44f4f90 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:49.905955 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d3fcc302-9b38-43ef-ac5f-ca31a44f4f90 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:50.080044 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-d3fcc302-9b38-43ef-ac5f-ca31a44f4f90 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:50.093161 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-d3fcc302-9b38-43ef-ac5f-ca31a44f4f90 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:50.097149 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-d3fcc302-9b38-43ef-ac5f-ca31a44f4f90 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:50.103440 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-d3fcc302-9b38-43ef-ac5f-ca31a44f4f90 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1406 microversion: 2.20 time: 0.230477 Jun 14 18:27:50.104019 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 58/106] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:27:49 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:27:50.116699 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-e1394219-8e0f-4702-ad33-fbf738204656 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:50.124524 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-e1394219-8e0f-4702-ad33-fbf738204656 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1364 microversion: 2.1 time: 0.249755 Jun 14 18:27:50.125097 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 49/107] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:49 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1364 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:50.711763 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-7c2b505d-17e1-4608-a435-687c126509c5 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:50.712375 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-7c2b505d-17e1-4608-a435-687c126509c5 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:50.719798 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7c2b505d-17e1-4608-a435-687c126509c5 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:50.720325 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7c2b505d-17e1-4608-a435-687c126509c5 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:50.721245 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7c2b505d-17e1-4608-a435-687c126509c5 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:50.721673 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7c2b505d-17e1-4608-a435-687c126509c5 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:50.862646 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-7c2b505d-17e1-4608-a435-687c126509c5 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:50.872423 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-7c2b505d-17e1-4608-a435-687c126509c5 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1321 microversion: 2.1 time: 0.164578 Jun 14 18:27:50.873775 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 59/108] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:50 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:51.121926 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-09bf837a-3793-4d76-9ca3-a50d0077de05 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:51.122577 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-09bf837a-3793-4d76-9ca3-a50d0077de05 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:51.128942 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-09bf837a-3793-4d76-9ca3-a50d0077de05 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:51.129407 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-09bf837a-3793-4d76-9ca3-a50d0077de05 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:51.130201 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-09bf837a-3793-4d76-9ca3-a50d0077de05 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:51.130639 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-09bf837a-3793-4d76-9ca3-a50d0077de05 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:51.142339 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-81137d61-f3a9-4171-b737-50de2b7396ca tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:51.142967 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-81137d61-f3a9-4171-b737-50de2b7396ca tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:51.149697 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-81137d61-f3a9-4171-b737-50de2b7396ca tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:51.150406 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-81137d61-f3a9-4171-b737-50de2b7396ca tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:51.151805 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-81137d61-f3a9-4171-b737-50de2b7396ca tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:51.152339 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-81137d61-f3a9-4171-b737-50de2b7396ca tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:51.284857 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-09bf837a-3793-4d76-9ca3-a50d0077de05 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:51.295952 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-81137d61-f3a9-4171-b737-50de2b7396ca tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:51.306634 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-81137d61-f3a9-4171-b737-50de2b7396ca tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1364 microversion: 2.1 time: 0.168097 Jun 14 18:27:51.307213 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 60/109] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:51 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:27:51.308860 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-09bf837a-3793-4d76-9ca3-a50d0077de05 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:51.310450 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-09bf837a-3793-4d76-9ca3-a50d0077de05 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:51.311558 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-09bf837a-3793-4d76-9ca3-a50d0077de05 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1406 microversion: 2.20 time: 0.193594 Jun 14 18:27:51.312254 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 50/110] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:27:51 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:27:51.890039 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-65675566-49a1-4288-88d1-b1b2b5ad7bf9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:51.890653 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-65675566-49a1-4288-88d1-b1b2b5ad7bf9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:51.892595 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell0:SELECT=6 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:27:51.897468 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-65675566-49a1-4288-88d1-b1b2b5ad7bf9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:51.897928 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-65675566-49a1-4288-88d1-b1b2b5ad7bf9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:51.898690 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-65675566-49a1-4288-88d1-b1b2b5ad7bf9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:51.899128 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-65675566-49a1-4288-88d1-b1b2b5ad7bf9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:52.052771 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-65675566-49a1-4288-88d1-b1b2b5ad7bf9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:52.060669 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-65675566-49a1-4288-88d1-b1b2b5ad7bf9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1321 microversion: 2.1 time: 0.175069 Jun 14 18:27:52.061049 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 61/111] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:51 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:52.325194 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-dd1928ca-50d2-4c22-a294-bce5b36ef5d6 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:52.325737 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-dd1928ca-50d2-4c22-a294-bce5b36ef5d6 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:52.330119 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-c7b9fca3-ff07-45b8-bb6d-c69ac62b42d8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:52.330733 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-c7b9fca3-ff07-45b8-bb6d-c69ac62b42d8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:52.332015 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-dd1928ca-50d2-4c22-a294-bce5b36ef5d6 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:52.332462 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-dd1928ca-50d2-4c22-a294-bce5b36ef5d6 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:52.333224 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-dd1928ca-50d2-4c22-a294-bce5b36ef5d6 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:52.333683 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-dd1928ca-50d2-4c22-a294-bce5b36ef5d6 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:52.336742 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c7b9fca3-ff07-45b8-bb6d-c69ac62b42d8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:52.337208 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c7b9fca3-ff07-45b8-bb6d-c69ac62b42d8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:52.338003 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c7b9fca3-ff07-45b8-bb6d-c69ac62b42d8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:52.338586 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c7b9fca3-ff07-45b8-bb6d-c69ac62b42d8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:52.486528 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-dd1928ca-50d2-4c22-a294-bce5b36ef5d6 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:52.486806 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-c7b9fca3-ff07-45b8-bb6d-c69ac62b42d8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:52.497871 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-c7b9fca3-ff07-45b8-bb6d-c69ac62b42d8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:52.499402 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-c7b9fca3-ff07-45b8-bb6d-c69ac62b42d8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:52.500735 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-c7b9fca3-ff07-45b8-bb6d-c69ac62b42d8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1406 microversion: 2.20 time: 0.174501 Jun 14 18:27:52.512044 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 62/112] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:27:52 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:27:52.512186 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-dd1928ca-50d2-4c22-a294-bce5b36ef5d6 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1364 microversion: 2.1 time: 0.186891 Jun 14 18:27:52.512186 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 51/113] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:52 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1364 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:53.087474 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-e116a3f9-ec9c-40b8-9429-5d36125d09d2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:53.088074 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-b0cee5a9-7aea-45dc-ad46-56af3a5b67f6 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "755a2c7a-fc95-4468-bb0d-cce74ab36fdc"}} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:27:53.089299 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-e116a3f9-ec9c-40b8-9429-5d36125d09d2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:53.094814 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-b0cee5a9-7aea-45dc-ad46-56af3a5b67f6 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] [instance: 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:53.110598 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b0cee5a9-7aea-45dc-ad46-56af3a5b67f6 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:53.111116 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e116a3f9-ec9c-40b8-9429-5d36125d09d2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:53.112766 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e116a3f9-ec9c-40b8-9429-5d36125d09d2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:53.113357 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b0cee5a9-7aea-45dc-ad46-56af3a5b67f6 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:53.113971 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e116a3f9-ec9c-40b8-9429-5d36125d09d2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:53.115023 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e116a3f9-ec9c-40b8-9429-5d36125d09d2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:53.115938 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b0cee5a9-7aea-45dc-ad46-56af3a5b67f6 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:53.118221 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b0cee5a9-7aea-45dc-ad46-56af3a5b67f6 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:53.656510 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-e116a3f9-ec9c-40b8-9429-5d36125d09d2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:53.668187 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-e116a3f9-ec9c-40b8-9429-5d36125d09d2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1321 microversion: 2.1 time: 0.592881 Jun 14 18:27:53.668925 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 52/114] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:53 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1321 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:53.675255 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-70b9d4e6-4a6d-4b24-b9ba-fc0bde89d944 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:53.676162 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-70b9d4e6-4a6d-4b24-b9ba-fc0bde89d944 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:53.683472 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-70b9d4e6-4a6d-4b24-b9ba-fc0bde89d944 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:53.684024 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-70b9d4e6-4a6d-4b24-b9ba-fc0bde89d944 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:53.684984 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-70b9d4e6-4a6d-4b24-b9ba-fc0bde89d944 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:53.685427 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-70b9d4e6-4a6d-4b24-b9ba-fc0bde89d944 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:53.905652 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-70b9d4e6-4a6d-4b24-b9ba-fc0bde89d944 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:53.915472 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-70b9d4e6-4a6d-4b24-b9ba-fc0bde89d944 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:53.917327 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-70b9d4e6-4a6d-4b24-b9ba-fc0bde89d944 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:53.919013 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-70b9d4e6-4a6d-4b24-b9ba-fc0bde89d944 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1406 microversion: 2.20 time: 0.248713 Jun 14 18:27:53.919754 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 53/115] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:27:53 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1406 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:27:53.939885 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-f61634b3-945c-40ef-b520-af2dff4a947c tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:53.940677 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-f61634b3-945c-40ef-b520-af2dff4a947c tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:53.947339 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f61634b3-945c-40ef-b520-af2dff4a947c tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:53.948745 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f61634b3-945c-40ef-b520-af2dff4a947c tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:53.949519 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f61634b3-945c-40ef-b520-af2dff4a947c tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:53.950052 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f61634b3-945c-40ef-b520-af2dff4a947c tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:54.161790 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-f61634b3-945c-40ef-b520-af2dff4a947c tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:54.173503 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-f61634b3-945c-40ef-b520-af2dff4a947c tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1364 microversion: 2.1 time: 0.252436 Jun 14 18:27:54.174440 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 54/116] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:53 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1364 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:54.686849 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-842fc1ca-29ea-40a7-a77a-2b6b5285544d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:54.687528 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-842fc1ca-29ea-40a7-a77a-2b6b5285544d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:54.695504 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-842fc1ca-29ea-40a7-a77a-2b6b5285544d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:54.695981 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-842fc1ca-29ea-40a7-a77a-2b6b5285544d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:54.696757 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-842fc1ca-29ea-40a7-a77a-2b6b5285544d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:54.697229 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-842fc1ca-29ea-40a7-a77a-2b6b5285544d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:54.819098 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-b0cee5a9-7aea-45dc-ad46-56af3a5b67f6 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] 10.222.0.78 "POST /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.744026 Jun 14 18:27:54.819713 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 63/117] 10.222.0.78 () {60 vars in 1322 bytes} [Tue Jun 14 18:27:53 2022] POST /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd/os-volume_attachments => generated 194 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:27:54.869608 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-842fc1ca-29ea-40a7-a77a-2b6b5285544d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:54.886365 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-842fc1ca-29ea-40a7-a77a-2b6b5285544d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1321 microversion: 2.1 time: 0.202915 Jun 14 18:27:54.888626 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 55/118] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:54 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:27:54.938725 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-b1fc9654-924f-4cb0-9c31-cc167826143c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:54.939310 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-b1fc9654-924f-4cb0-9c31-cc167826143c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:54.947242 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b1fc9654-924f-4cb0-9c31-cc167826143c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:54.947711 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b1fc9654-924f-4cb0-9c31-cc167826143c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:54.949285 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b1fc9654-924f-4cb0-9c31-cc167826143c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:54.949765 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b1fc9654-924f-4cb0-9c31-cc167826143c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:55.049190 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-a474ebdb-d8e0-4bf0-a040-63fe36fd3822 req-e95b3f59-6c9a-49ac-9434-0dbaebdf428d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2876875b-5dbe-4032-949a-3357292296a2", "name": "network-vif-plugged", "status": "completed", "tag": "ee384335-560e-4f82-a137-0b23b61ff825"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:27:55.058907 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-a474ebdb-d8e0-4bf0-a040-63fe36fd3822 req-e95b3f59-6c9a-49ac-9434-0dbaebdf428d service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:55.059550 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-a474ebdb-d8e0-4bf0-a040-63fe36fd3822 req-e95b3f59-6c9a-49ac-9434-0dbaebdf428d service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:55.072151 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-a474ebdb-d8e0-4bf0-a040-63fe36fd3822 req-e95b3f59-6c9a-49ac-9434-0dbaebdf428d service nova] Creating event network-vif-plugged:ee384335-560e-4f82-a137-0b23b61ff825 for instance 2876875b-5dbe-4032-949a-3357292296a2 on hv-cinder-84456 Jun 14 18:27:55.078053 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-a474ebdb-d8e0-4bf0-a040-63fe36fd3822 req-e95b3f59-6c9a-49ac-9434-0dbaebdf428d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032701 Jun 14 18:27:55.079014 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 56/119] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:27:55.105576 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-b1fc9654-924f-4cb0-9c31-cc167826143c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:55.113608 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-b1fc9654-924f-4cb0-9c31-cc167826143c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:55.115117 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-b1fc9654-924f-4cb0-9c31-cc167826143c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:55.116227 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-b1fc9654-924f-4cb0-9c31-cc167826143c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1406 microversion: 2.20 time: 0.183469 Jun 14 18:27:55.116786 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 64/120] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:27:54 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:27:55.192032 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-d3bf1436-a68d-49d0-bd07-e0c8f22d659b tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:55.192967 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-d3bf1436-a68d-49d0-bd07-e0c8f22d659b tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:55.208811 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d3bf1436-a68d-49d0-bd07-e0c8f22d659b tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:55.209281 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d3bf1436-a68d-49d0-bd07-e0c8f22d659b tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:55.210577 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d3bf1436-a68d-49d0-bd07-e0c8f22d659b tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:55.211029 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d3bf1436-a68d-49d0-bd07-e0c8f22d659b tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:55.397592 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-d3bf1436-a68d-49d0-bd07-e0c8f22d659b tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:55.407704 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-d3bf1436-a68d-49d0-bd07-e0c8f22d659b tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1364 microversion: 2.1 time: 0.219850 Jun 14 18:27:55.408669 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 57/121] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:55 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1364 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:55.905474 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-7a22e90d-dc48-41ea-a9c4-5b46f52f7e43 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:55.906144 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-7a22e90d-dc48-41ea-a9c4-5b46f52f7e43 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:55.908244 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:27:55.923440 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7a22e90d-dc48-41ea-a9c4-5b46f52f7e43 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:55.924055 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7a22e90d-dc48-41ea-a9c4-5b46f52f7e43 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:55.925621 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7a22e90d-dc48-41ea-a9c4-5b46f52f7e43 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:55.926214 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7a22e90d-dc48-41ea-a9c4-5b46f52f7e43 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:56.097031 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-7a22e90d-dc48-41ea-a9c4-5b46f52f7e43 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:56.105560 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-7a22e90d-dc48-41ea-a9c4-5b46f52f7e43 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1321 microversion: 2.1 time: 0.204085 Jun 14 18:27:56.106225 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 65/122] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:55 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:56.135302 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-16ff5463-1711-4b50-93b6-b3d4b20d2cc4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:56.136086 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-16ff5463-1711-4b50-93b6-b3d4b20d2cc4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:56.144841 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-16ff5463-1711-4b50-93b6-b3d4b20d2cc4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:56.145286 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-16ff5463-1711-4b50-93b6-b3d4b20d2cc4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:56.146292 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-16ff5463-1711-4b50-93b6-b3d4b20d2cc4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:56.146732 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-16ff5463-1711-4b50-93b6-b3d4b20d2cc4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:56.306994 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-16ff5463-1711-4b50-93b6-b3d4b20d2cc4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:56.315921 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-16ff5463-1711-4b50-93b6-b3d4b20d2cc4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:56.317438 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-16ff5463-1711-4b50-93b6-b3d4b20d2cc4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:56.318722 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-16ff5463-1711-4b50-93b6-b3d4b20d2cc4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1406 microversion: 2.20 time: 0.187626 Jun 14 18:27:56.319276 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 58/123] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:27:56 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:27:56.426344 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-eb8bc83a-7905-4200-bdff-56990f2d4cee tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:56.426946 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-eb8bc83a-7905-4200-bdff-56990f2d4cee tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:56.435314 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-eb8bc83a-7905-4200-bdff-56990f2d4cee tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:56.435778 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-eb8bc83a-7905-4200-bdff-56990f2d4cee tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:56.436580 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-eb8bc83a-7905-4200-bdff-56990f2d4cee tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:56.437019 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-eb8bc83a-7905-4200-bdff-56990f2d4cee tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:56.645919 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-eb8bc83a-7905-4200-bdff-56990f2d4cee tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:56.654828 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-eb8bc83a-7905-4200-bdff-56990f2d4cee tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1364 microversion: 2.1 time: 0.232572 Jun 14 18:27:56.655407 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 66/124] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:56 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1364 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:57.097943 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-e4c9cbe1-94ec-4cf4-8dfe-f73f07cca0a8 req-1613b10e-15a9-4053-9ee3-381a19837aaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee", "name": "network-vif-plugged", "status": "completed", "tag": "dcaeaf29-4f8b-4d99-8c22-29b129b65a8c"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:27:57.103990 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:27:57.111243 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-e4c9cbe1-94ec-4cf4-8dfe-f73f07cca0a8 req-1613b10e-15a9-4053-9ee3-381a19837aaa service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:57.112220 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-e4c9cbe1-94ec-4cf4-8dfe-f73f07cca0a8 req-1613b10e-15a9-4053-9ee3-381a19837aaa service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:57.123190 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-f738db75-2c23-415b-a766-40853fc2b1cc tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:57.123921 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-f738db75-2c23-415b-a766-40853fc2b1cc tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:57.136938 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-e4c9cbe1-94ec-4cf4-8dfe-f73f07cca0a8 req-1613b10e-15a9-4053-9ee3-381a19837aaa service nova] Creating event network-vif-plugged:dcaeaf29-4f8b-4d99-8c22-29b129b65a8c for instance 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee on hv-cinder-84456 Jun 14 18:27:57.139355 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f738db75-2c23-415b-a766-40853fc2b1cc tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:57.139809 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f738db75-2c23-415b-a766-40853fc2b1cc tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:57.140684 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f738db75-2c23-415b-a766-40853fc2b1cc tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:57.141124 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f738db75-2c23-415b-a766-40853fc2b1cc tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:57.145939 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:27:57.152868 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-e4c9cbe1-94ec-4cf4-8dfe-f73f07cca0a8 req-1613b10e-15a9-4053-9ee3-381a19837aaa service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058145 Jun 14 18:27:57.153744 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 59/125] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:27:57.293853 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-f738db75-2c23-415b-a766-40853fc2b1cc tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:57.301291 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-f738db75-2c23-415b-a766-40853fc2b1cc tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1321 microversion: 2.1 time: 0.182571 Jun 14 18:27:57.302149 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 67/126] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:57 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:27:57.337248 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-4f97b33b-b8ff-44f1-84db-d9954362b4d0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:57.338151 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-4f97b33b-b8ff-44f1-84db-d9954362b4d0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:57.346583 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4f97b33b-b8ff-44f1-84db-d9954362b4d0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:57.347268 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4f97b33b-b8ff-44f1-84db-d9954362b4d0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:57.348259 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4f97b33b-b8ff-44f1-84db-d9954362b4d0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:57.348777 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4f97b33b-b8ff-44f1-84db-d9954362b4d0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:57.373810 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell1:SELECT=100 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:27:57.531561 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-4f97b33b-b8ff-44f1-84db-d9954362b4d0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:57.540957 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-4f97b33b-b8ff-44f1-84db-d9954362b4d0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:57.544604 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-4f97b33b-b8ff-44f1-84db-d9954362b4d0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:57.545793 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-4f97b33b-b8ff-44f1-84db-d9954362b4d0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1406 microversion: 2.20 time: 0.213280 Jun 14 18:27:57.546359 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 60/127] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:27:57 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1406 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:27:57.674175 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-c9af8bfe-8762-49d8-a35c-9c9362fc617e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:57.675359 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-c9af8bfe-8762-49d8-a35c-9c9362fc617e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:57.683422 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c9af8bfe-8762-49d8-a35c-9c9362fc617e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:57.683997 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c9af8bfe-8762-49d8-a35c-9c9362fc617e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:57.685108 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c9af8bfe-8762-49d8-a35c-9c9362fc617e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:57.686585 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c9af8bfe-8762-49d8-a35c-9c9362fc617e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:57.841908 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-c9af8bfe-8762-49d8-a35c-9c9362fc617e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:57.849760 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-c9af8bfe-8762-49d8-a35c-9c9362fc617e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1364 microversion: 2.1 time: 0.180471 Jun 14 18:27:57.850387 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 68/128] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:57 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1364 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:58.322533 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-c458b8d0-f81f-4946-ae07-84a9296bc187 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:58.323038 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-c458b8d0-f81f-4946-ae07-84a9296bc187 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:58.331117 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c458b8d0-f81f-4946-ae07-84a9296bc187 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:58.331722 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c458b8d0-f81f-4946-ae07-84a9296bc187 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:58.332562 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c458b8d0-f81f-4946-ae07-84a9296bc187 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:58.333186 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c458b8d0-f81f-4946-ae07-84a9296bc187 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:58.494430 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-c458b8d0-f81f-4946-ae07-84a9296bc187 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:58.503121 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-c458b8d0-f81f-4946-ae07-84a9296bc187 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1321 microversion: 2.1 time: 0.187774 Jun 14 18:27:58.503704 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 61/129] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:58 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:27:58.568560 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-74ce97a7-1e22-45bb-b386-031992fb1337 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:58.570987 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-74ce97a7-1e22-45bb-b386-031992fb1337 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:58.586774 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-74ce97a7-1e22-45bb-b386-031992fb1337 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:58.587614 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-74ce97a7-1e22-45bb-b386-031992fb1337 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:58.589646 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-74ce97a7-1e22-45bb-b386-031992fb1337 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:58.590276 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-74ce97a7-1e22-45bb-b386-031992fb1337 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:58.765847 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-74ce97a7-1e22-45bb-b386-031992fb1337 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:58.774279 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-74ce97a7-1e22-45bb-b386-031992fb1337 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:58.776259 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-74ce97a7-1e22-45bb-b386-031992fb1337 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:58.778299 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-74ce97a7-1e22-45bb-b386-031992fb1337 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1599 microversion: 2.20 time: 0.217070 Jun 14 18:27:58.778858 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 69/130] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:27:58 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:27:58.799028 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-c5fe677d-b6b8-432b-9db2-50d2f98db133 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:58.799525 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-c5fe677d-b6b8-432b-9db2-50d2f98db133 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:58.805721 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c5fe677d-b6b8-432b-9db2-50d2f98db133 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:58.806177 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c5fe677d-b6b8-432b-9db2-50d2f98db133 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:58.807178 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c5fe677d-b6b8-432b-9db2-50d2f98db133 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:58.807663 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c5fe677d-b6b8-432b-9db2-50d2f98db133 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:58.869294 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-e37e1a2d-e1f1-446b-b107-d33672f20175 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:58.871105 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-e37e1a2d-e1f1-446b-b107-d33672f20175 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:58.883217 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e37e1a2d-e1f1-446b-b107-d33672f20175 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:58.884420 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e37e1a2d-e1f1-446b-b107-d33672f20175 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:58.886502 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e37e1a2d-e1f1-446b-b107-d33672f20175 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:58.889945 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e37e1a2d-e1f1-446b-b107-d33672f20175 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:59.043299 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-c5fe677d-b6b8-432b-9db2-50d2f98db133 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.247302 Jun 14 18:27:59.044477 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 62/131] 10.222.0.78 () {60 vars in 1315 bytes} [Tue Jun 14 18:27:58 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2/os-interface => generated 285 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 18:27:59.521129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-4cbe45b8-9bdd-45b3-bc6a-efab5e99fe39 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:27:59.521947 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-4cbe45b8-9bdd-45b3-bc6a-efab5e99fe39 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:27:59.530076 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-e37e1a2d-e1f1-446b-b107-d33672f20175 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:59.530677 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4cbe45b8-9bdd-45b3-bc6a-efab5e99fe39 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:59.531357 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4cbe45b8-9bdd-45b3-bc6a-efab5e99fe39 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:59.532545 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4cbe45b8-9bdd-45b3-bc6a-efab5e99fe39 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:27:59.533385 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4cbe45b8-9bdd-45b3-bc6a-efab5e99fe39 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:27:59.541784 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-e37e1a2d-e1f1-446b-b107-d33672f20175 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1364 microversion: 2.1 time: 0.677094 Jun 14 18:27:59.552196 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 70/132] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:58 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1364 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:27:59.680796 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-4cbe45b8-9bdd-45b3-bc6a-efab5e99fe39 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:27:59.689916 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-4cbe45b8-9bdd-45b3-bc6a-efab5e99fe39 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1321 microversion: 2.1 time: 0.173163 Jun 14 18:27:59.690819 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 63/133] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:27:59 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:00.561241 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-a7aafc39-c5e5-4c5b-9d07-9e10ec2815d2 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:00.562418 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-a7aafc39-c5e5-4c5b-9d07-9e10ec2815d2 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:00.574928 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a7aafc39-c5e5-4c5b-9d07-9e10ec2815d2 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:00.575397 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a7aafc39-c5e5-4c5b-9d07-9e10ec2815d2 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:00.576172 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a7aafc39-c5e5-4c5b-9d07-9e10ec2815d2 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:00.579197 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a7aafc39-c5e5-4c5b-9d07-9e10ec2815d2 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:00.708605 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-f054b24f-d9e7-43b4-8842-1a50b5758e14 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:00.709411 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-f054b24f-d9e7-43b4-8842-1a50b5758e14 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:00.716592 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f054b24f-d9e7-43b4-8842-1a50b5758e14 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:00.717052 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f054b24f-d9e7-43b4-8842-1a50b5758e14 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:00.717866 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f054b24f-d9e7-43b4-8842-1a50b5758e14 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:00.718597 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f054b24f-d9e7-43b4-8842-1a50b5758e14 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:01.119923 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-a7aafc39-c5e5-4c5b-9d07-9e10ec2815d2 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:01.130028 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-a7aafc39-c5e5-4c5b-9d07-9e10ec2815d2 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1364 microversion: 2.1 time: 0.574176 Jun 14 18:28:01.131520 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 71/134] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:00 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1364 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:01.146545 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-d49fa28f-fbd4-4f27-9295-6ea96ed68c76 req-0519d9c4-be70-4177-806c-e065ae3cca5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90a63d77-87d7-4616-af3d-fe6cb12e93fe", "name": "network-vif-plugged", "status": "completed", "tag": "7513d78b-6877-4846-a318-fbe800a362f4"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:28:01.153724 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-f054b24f-d9e7-43b4-8842-1a50b5758e14 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:01.159752 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-d49fa28f-fbd4-4f27-9295-6ea96ed68c76 req-0519d9c4-be70-4177-806c-e065ae3cca5b service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:01.160394 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-d49fa28f-fbd4-4f27-9295-6ea96ed68c76 req-0519d9c4-be70-4177-806c-e065ae3cca5b service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:01.168762 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-f054b24f-d9e7-43b4-8842-1a50b5758e14 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1515 microversion: 2.1 time: 0.463574 Jun 14 18:28:01.170067 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 64/135] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:00 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1515 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:28:01.176527 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-d49fa28f-fbd4-4f27-9295-6ea96ed68c76 req-0519d9c4-be70-4177-806c-e065ae3cca5b service nova] Creating event network-vif-plugged:7513d78b-6877-4846-a318-fbe800a362f4 for instance 90a63d77-87d7-4616-af3d-fe6cb12e93fe on hv-cinder-84456 Jun 14 18:28:01.182481 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-d49fa28f-fbd4-4f27-9295-6ea96ed68c76 req-0519d9c4-be70-4177-806c-e065ae3cca5b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049393 Jun 14 18:28:01.191736 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-d6ed7608-82a9-4170-81c1-f540a1a0aa16 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:28:01.193733 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-d6ed7608-82a9-4170-81c1-f540a1a0aa16 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:01.200787 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 72/136] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:28:01.202810 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d6ed7608-82a9-4170-81c1-f540a1a0aa16 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:01.203786 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d6ed7608-82a9-4170-81c1-f540a1a0aa16 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:01.212933 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d6ed7608-82a9-4170-81c1-f540a1a0aa16 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:01.216528 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d6ed7608-82a9-4170-81c1-f540a1a0aa16 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:01.280522 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.objects.instance [None req-d6ed7608-82a9-4170-81c1-f540a1a0aa16 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lazy-loading 'flavor' on Instance uuid 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee {{(pid=118623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:28:01.402090 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-714af7aa-c4ec-48bf-b730-9c64e4d84488 req-0fdf980f-b8a6-401e-8a52-5e573cc152c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2876875b-5dbe-4032-949a-3357292296a2", "tag": "ee384335-560e-4f82-a137-0b23b61ff825"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:28:01.429138 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-714af7aa-c4ec-48bf-b730-9c64e4d84488 req-0fdf980f-b8a6-401e-8a52-5e573cc152c3 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:01.429710 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-714af7aa-c4ec-48bf-b730-9c64e4d84488 req-0fdf980f-b8a6-401e-8a52-5e573cc152c3 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:01.464255 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-714af7aa-c4ec-48bf-b730-9c64e4d84488 req-0fdf980f-b8a6-401e-8a52-5e573cc152c3 service nova] Creating event network-changed:ee384335-560e-4f82-a137-0b23b61ff825 for instance 2876875b-5dbe-4032-949a-3357292296a2 on hv-cinder-84456 Jun 14 18:28:01.469683 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-714af7aa-c4ec-48bf-b730-9c64e4d84488 req-0fdf980f-b8a6-401e-8a52-5e573cc152c3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073053 Jun 14 18:28:01.470286 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 73/137] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:28:01.733890 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-d6ed7608-82a9-4170-81c1-f540a1a0aa16 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "POST /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee/action" status: 200 len: 32 microversion: 2.1 time: 0.548943 Jun 14 18:28:01.736022 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 65/138] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Jun 14 18:28:01 2022] POST /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee/action => generated 32 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 14 18:28:01.746745 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-89b0c855-a09b-49f2-8b7e-6e29a385d8a6 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:01.747454 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-89b0c855-a09b-49f2-8b7e-6e29a385d8a6 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:01.759674 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-89b0c855-a09b-49f2-8b7e-6e29a385d8a6 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:01.769871 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-89b0c855-a09b-49f2-8b7e-6e29a385d8a6 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:01.771138 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-89b0c855-a09b-49f2-8b7e-6e29a385d8a6 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:01.771778 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-89b0c855-a09b-49f2-8b7e-6e29a385d8a6 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:02.018124 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-89b0c855-a09b-49f2-8b7e-6e29a385d8a6 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:02.026955 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-89b0c855-a09b-49f2-8b7e-6e29a385d8a6 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1521 microversion: 2.1 time: 0.285016 Jun 14 18:28:02.028966 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 74/139] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:01 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:02.150321 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-a11840f0-45dd-47c9-ade5-6eadbefff3b7 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:02.154327 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-a11840f0-45dd-47c9-ade5-6eadbefff3b7 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:02.172276 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a11840f0-45dd-47c9-ade5-6eadbefff3b7 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:02.175393 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a11840f0-45dd-47c9-ade5-6eadbefff3b7 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:02.175393 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a11840f0-45dd-47c9-ade5-6eadbefff3b7 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:02.175393 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a11840f0-45dd-47c9-ade5-6eadbefff3b7 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:02.437239 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-a11840f0-45dd-47c9-ade5-6eadbefff3b7 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:02.451837 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-a11840f0-45dd-47c9-ade5-6eadbefff3b7 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1364 microversion: 2.1 time: 0.307095 Jun 14 18:28:02.454762 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 66/140] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:02 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1364 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:03.048051 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-a228fea4-d81f-4899-b12e-3b77a6c71b46 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:03.049285 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-a228fea4-d81f-4899-b12e-3b77a6c71b46 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:03.060176 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a228fea4-d81f-4899-b12e-3b77a6c71b46 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:03.061077 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a228fea4-d81f-4899-b12e-3b77a6c71b46 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:03.062211 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a228fea4-d81f-4899-b12e-3b77a6c71b46 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:03.062799 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a228fea4-d81f-4899-b12e-3b77a6c71b46 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:03.280140 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-a228fea4-d81f-4899-b12e-3b77a6c71b46 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:03.289803 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-a228fea4-d81f-4899-b12e-3b77a6c71b46 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1521 microversion: 2.1 time: 0.244092 Jun 14 18:28:03.289803 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 75/141] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:03 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:03.473736 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-a951e8d3-634e-428b-9bc6-f2af357f692e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:03.474386 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-a951e8d3-634e-428b-9bc6-f2af357f692e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:03.482691 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a951e8d3-634e-428b-9bc6-f2af357f692e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:03.483174 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a951e8d3-634e-428b-9bc6-f2af357f692e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:03.484254 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a951e8d3-634e-428b-9bc6-f2af357f692e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:03.484929 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a951e8d3-634e-428b-9bc6-f2af357f692e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:03.631595 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-a951e8d3-634e-428b-9bc6-f2af357f692e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:03.637815 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-a951e8d3-634e-428b-9bc6-f2af357f692e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1364 microversion: 2.1 time: 0.168538 Jun 14 18:28:03.638583 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 67/142] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:03 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:04.323393 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-7f6a024d-5da8-40dc-9ff2-0086b53a82f2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:04.325364 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-7f6a024d-5da8-40dc-9ff2-0086b53a82f2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:04.345255 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7f6a024d-5da8-40dc-9ff2-0086b53a82f2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:04.345740 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7f6a024d-5da8-40dc-9ff2-0086b53a82f2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:04.346536 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7f6a024d-5da8-40dc-9ff2-0086b53a82f2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:04.349183 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7f6a024d-5da8-40dc-9ff2-0086b53a82f2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:04.628219 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-7f6a024d-5da8-40dc-9ff2-0086b53a82f2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:04.639834 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-7f6a024d-5da8-40dc-9ff2-0086b53a82f2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1521 microversion: 2.1 time: 0.337073 Jun 14 18:28:04.641229 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 76/143] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:04 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1521 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:04.662026 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-4037c20d-3c70-4290-aa1a-1f6f062d27ce tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:04.666952 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-4037c20d-3c70-4290-aa1a-1f6f062d27ce tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:04.679135 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4037c20d-3c70-4290-aa1a-1f6f062d27ce tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:04.680313 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4037c20d-3c70-4290-aa1a-1f6f062d27ce tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:04.681256 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4037c20d-3c70-4290-aa1a-1f6f062d27ce tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:04.681925 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4037c20d-3c70-4290-aa1a-1f6f062d27ce tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:04.959020 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-4037c20d-3c70-4290-aa1a-1f6f062d27ce tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:04.984854 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-4037c20d-3c70-4290-aa1a-1f6f062d27ce tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1549 microversion: 2.1 time: 0.333408 Jun 14 18:28:04.986772 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 68/144] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:04 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1549 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:05.006926 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-2005e702-9b7c-4bb0-ab94-d240eb1ee37c tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:05.007518 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-2005e702-9b7c-4bb0-ab94-d240eb1ee37c tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:05.018170 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2005e702-9b7c-4bb0-ab94-d240eb1ee37c tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:05.019264 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2005e702-9b7c-4bb0-ab94-d240eb1ee37c tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:05.020204 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2005e702-9b7c-4bb0-ab94-d240eb1ee37c tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:05.021895 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2005e702-9b7c-4bb0-ab94-d240eb1ee37c tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:05.174699 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-2005e702-9b7c-4bb0-ab94-d240eb1ee37c tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.172918 Jun 14 18:28:05.175651 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 77/145] 10.222.0.78 () {58 vars in 1274 bytes} [Tue Jun 14 18:28:05 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe/os-interface => generated 284 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:28:05.659375 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-621bbb9d-bec3-431b-a98e-3060c0c3b2a3 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:05.660284 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-621bbb9d-bec3-431b-a98e-3060c0c3b2a3 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:05.670274 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-621bbb9d-bec3-431b-a98e-3060c0c3b2a3 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:05.671568 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-621bbb9d-bec3-431b-a98e-3060c0c3b2a3 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:05.671800 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-621bbb9d-bec3-431b-a98e-3060c0c3b2a3 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:05.672245 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-621bbb9d-bec3-431b-a98e-3060c0c3b2a3 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:05.979098 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-621bbb9d-bec3-431b-a98e-3060c0c3b2a3 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:05.982125 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-621bbb9d-bec3-431b-a98e-3060c0c3b2a3 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1521 microversion: 2.1 time: 0.328157 Jun 14 18:28:05.982961 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 69/146] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:05 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1521 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:06.454266 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-cb9da2d8-68a0-430f-b191-5b43fc439870 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:06.454751 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-cb9da2d8-68a0-430f-b191-5b43fc439870 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] [instance: 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:06.461702 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-cb9da2d8-68a0-430f-b191-5b43fc439870 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:06.462160 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-cb9da2d8-68a0-430f-b191-5b43fc439870 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:06.463509 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-cb9da2d8-68a0-430f-b191-5b43fc439870 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:06.477735 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-cb9da2d8-68a0-430f-b191-5b43fc439870 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:06.517992 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-cb9da2d8-68a0-430f-b191-5b43fc439870 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] [instance: 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd] Going to try to terminate instance {{(pid=118624) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:28:06.953172 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-b47376df-3cc3-40ef-8d2b-f518ca2d59ba req-6e15b69d-0fbc-4873-9659-6d506edb10a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90a63d77-87d7-4616-af3d-fe6cb12e93fe", "tag": "7513d78b-6877-4846-a318-fbe800a362f4"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:28:06.956696 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-cb9da2d8-68a0-430f-b191-5b43fc439870 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd" status: 204 len: 0 microversion: 2.1 time: 0.506696 Jun 14 18:28:06.966578 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 78/147] 10.222.0.78 () {58 vars in 1238 bytes} [Tue Jun 14 18:28:06 2022] DELETE /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd => generated 0 bytes in 510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 18:28:06.969790 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-b47376df-3cc3-40ef-8d2b-f518ca2d59ba req-6e15b69d-0fbc-4873-9659-6d506edb10a4 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:06.970237 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-b47376df-3cc3-40ef-8d2b-f518ca2d59ba req-6e15b69d-0fbc-4873-9659-6d506edb10a4 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:06.972853 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-2b176e1a-37fe-4d59-b588-ee426eb82d40 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:06.974005 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-2b176e1a-37fe-4d59-b588-ee426eb82d40 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] [instance: 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:06.984084 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-b47376df-3cc3-40ef-8d2b-f518ca2d59ba req-6e15b69d-0fbc-4873-9659-6d506edb10a4 service nova] Creating event network-changed:7513d78b-6877-4846-a318-fbe800a362f4 for instance 90a63d77-87d7-4616-af3d-fe6cb12e93fe on hv-cinder-84456 Jun 14 18:28:06.993238 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2b176e1a-37fe-4d59-b588-ee426eb82d40 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:06.995249 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-b47376df-3cc3-40ef-8d2b-f518ca2d59ba req-6e15b69d-0fbc-4873-9659-6d506edb10a4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059053 Jun 14 18:28:06.995515 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 70/148] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:28:07.001925 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-88429781-a11b-4475-adec-c716fbfc53de tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:07.006449 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2b176e1a-37fe-4d59-b588-ee426eb82d40 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:07.007488 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2b176e1a-37fe-4d59-b588-ee426eb82d40 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:07.009820 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2b176e1a-37fe-4d59-b588-ee426eb82d40 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:07.013706 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-88429781-a11b-4475-adec-c716fbfc53de tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:07.034792 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-88429781-a11b-4475-adec-c716fbfc53de tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:07.035444 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-88429781-a11b-4475-adec-c716fbfc53de tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:07.050753 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-88429781-a11b-4475-adec-c716fbfc53de tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:07.051198 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-88429781-a11b-4475-adec-c716fbfc53de tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:07.305897 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-2b176e1a-37fe-4d59-b588-ee426eb82d40 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419d0cc6ca7e426cb28257b32037901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea8b1ec08d6485ab1ac360549789d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:07.318201 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-2b176e1a-37fe-4d59-b588-ee426eb82d40 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] 10.222.0.78 "GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd" status: 200 len: 1552 microversion: 2.1 time: 0.350658 Jun 14 18:28:07.318788 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 79/149] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:06 2022] GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd => generated 1552 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:07.352617 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-88429781-a11b-4475-adec-c716fbfc53de tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:07.363605 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-88429781-a11b-4475-adec-c716fbfc53de tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1521 microversion: 2.1 time: 0.366650 Jun 14 18:28:07.366700 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 71/150] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:06 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1521 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:08.337315 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-ad3bfc9e-1c05-4598-8e1f-faf4d808d22c tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:08.339315 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-ad3bfc9e-1c05-4598-8e1f-faf4d808d22c tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] [instance: 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:08.348117 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ad3bfc9e-1c05-4598-8e1f-faf4d808d22c tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:08.348824 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ad3bfc9e-1c05-4598-8e1f-faf4d808d22c tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:08.349787 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ad3bfc9e-1c05-4598-8e1f-faf4d808d22c tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:08.350235 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ad3bfc9e-1c05-4598-8e1f-faf4d808d22c tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:08.380624 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-2909e48d-d304-40fc-9ce4-9a0c021736d6 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:08.381915 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-2909e48d-d304-40fc-9ce4-9a0c021736d6 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:08.391195 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2909e48d-d304-40fc-9ce4-9a0c021736d6 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:08.391909 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2909e48d-d304-40fc-9ce4-9a0c021736d6 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:08.392876 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2909e48d-d304-40fc-9ce4-9a0c021736d6 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:08.405877 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2909e48d-d304-40fc-9ce4-9a0c021736d6 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:08.603544 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-ad3bfc9e-1c05-4598-8e1f-faf4d808d22c tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419d0cc6ca7e426cb28257b32037901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea8b1ec08d6485ab1ac360549789d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:08.611735 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-2909e48d-d304-40fc-9ce4-9a0c021736d6 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:08.614073 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-ad3bfc9e-1c05-4598-8e1f-faf4d808d22c tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] 10.222.0.78 "GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd" status: 200 len: 1552 microversion: 2.1 time: 0.281286 Jun 14 18:28:08.624559 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 80/151] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:08 2022] GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd => generated 1552 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:08.629996 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-2909e48d-d304-40fc-9ce4-9a0c021736d6 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1521 microversion: 2.1 time: 0.253543 Jun 14 18:28:08.631101 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 72/152] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:08 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:28:09.637318 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-46841616-868f-4264-ba67-5df2b33df3f3 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:09.639117 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-46841616-868f-4264-ba67-5df2b33df3f3 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] [instance: 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:09.659295 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-804b29aa-47df-46c4-a438-dfb1cdd0f313 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:09.661491 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-804b29aa-47df-46c4-a438-dfb1cdd0f313 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:09.663543 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-46841616-868f-4264-ba67-5df2b33df3f3 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:09.664110 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-46841616-868f-4264-ba67-5df2b33df3f3 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:09.666348 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-46841616-868f-4264-ba67-5df2b33df3f3 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:09.667572 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-46841616-868f-4264-ba67-5df2b33df3f3 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:09.678888 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-804b29aa-47df-46c4-a438-dfb1cdd0f313 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:09.680389 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-804b29aa-47df-46c4-a438-dfb1cdd0f313 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:09.683962 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-804b29aa-47df-46c4-a438-dfb1cdd0f313 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:09.685073 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-804b29aa-47df-46c4-a438-dfb1cdd0f313 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:09.853255 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-46841616-868f-4264-ba67-5df2b33df3f3 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419d0cc6ca7e426cb28257b32037901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea8b1ec08d6485ab1ac360549789d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:09.860013 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-804b29aa-47df-46c4-a438-dfb1cdd0f313 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:09.869307 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-46841616-868f-4264-ba67-5df2b33df3f3 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] 10.222.0.78 "GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd" status: 200 len: 1552 microversion: 2.1 time: 0.239041 Jun 14 18:28:09.874823 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 81/153] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:09 2022] GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd => generated 1552 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:09.875039 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-804b29aa-47df-46c4-a438-dfb1cdd0f313 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1521 microversion: 2.1 time: 0.223087 Jun 14 18:28:09.875039 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 73/154] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:09 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:10.093369 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-530b3fd5-a893-46a7-9800-a7d2a2dd125c req-8f387733-bf11-4efc-88b7-fa2c8aeb28ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd", "name": "network-vif-deleted", "tag": "1de4fd5a-d3c5-41de-a140-a242d715583a"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:28:10.108718 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-530b3fd5-a893-46a7-9800-a7d2a2dd125c req-8f387733-bf11-4efc-88b7-fa2c8aeb28ad service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:10.109636 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-530b3fd5-a893-46a7-9800-a7d2a2dd125c req-8f387733-bf11-4efc-88b7-fa2c8aeb28ad service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:10.132198 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-530b3fd5-a893-46a7-9800-a7d2a2dd125c req-8f387733-bf11-4efc-88b7-fa2c8aeb28ad service nova] Creating event network-vif-deleted:1de4fd5a-d3c5-41de-a140-a242d715583a for instance 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd on hv-cinder-84456 Jun 14 18:28:10.142379 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-530b3fd5-a893-46a7-9800-a7d2a2dd125c req-8f387733-bf11-4efc-88b7-fa2c8aeb28ad service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057127 Jun 14 18:28:10.143706 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 82/155] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:28:10.904824 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-b8b4cc3b-5342-409b-841a-8de57606108f tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:10.905563 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-b8b4cc3b-5342-409b-841a-8de57606108f tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:10.906919 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-ddf57ebd-59fb-4617-8509-9f6de64a7995 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:10.908337 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-ddf57ebd-59fb-4617-8509-9f6de64a7995 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] [instance: 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:10.918630 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b8b4cc3b-5342-409b-841a-8de57606108f tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:10.918929 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b8b4cc3b-5342-409b-841a-8de57606108f tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:10.919627 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b8b4cc3b-5342-409b-841a-8de57606108f tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:10.920079 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b8b4cc3b-5342-409b-841a-8de57606108f tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:10.920206 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ddf57ebd-59fb-4617-8509-9f6de64a7995 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:10.920839 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ddf57ebd-59fb-4617-8509-9f6de64a7995 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:10.922043 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ddf57ebd-59fb-4617-8509-9f6de64a7995 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:10.922682 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ddf57ebd-59fb-4617-8509-9f6de64a7995 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:11.013601 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-ddf57ebd-59fb-4617-8509-9f6de64a7995 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419d0cc6ca7e426cb28257b32037901d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea8b1ec08d6485ab1ac360549789d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:11.022379 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-ddf57ebd-59fb-4617-8509-9f6de64a7995 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] 10.222.0.78 "GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd" status: 200 len: 1345 microversion: 2.1 time: 0.124818 Jun 14 18:28:11.022729 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 74/156] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:10 2022] GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd => generated 1345 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:11.116914 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-b8b4cc3b-5342-409b-841a-8de57606108f tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:11.124836 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-b8b4cc3b-5342-409b-841a-8de57606108f tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1521 microversion: 2.1 time: 0.224227 Jun 14 18:28:11.125416 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 83/157] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:10 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:12.039594 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-d118d4cc-b9bb-41aa-8a36-bfbe3075621a tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:12.040718 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-d118d4cc-b9bb-41aa-8a36-bfbe3075621a tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] [instance: 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:12.053354 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d118d4cc-b9bb-41aa-8a36-bfbe3075621a tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:12.053354 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d118d4cc-b9bb-41aa-8a36-bfbe3075621a tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:12.053354 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d118d4cc-b9bb-41aa-8a36-bfbe3075621a tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:12.053354 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d118d4cc-b9bb-41aa-8a36-bfbe3075621a tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:12.063139 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.wsgi [None req-d118d4cc-b9bb-41aa-8a36-bfbe3075621a tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] HTTP exception thrown: Instance 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd could not be found. Jun 14 18:28:12.067736 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-d118d4cc-b9bb-41aa-8a36-bfbe3075621a tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Request method failure captured: Jun 14 18:28:12.067736 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: request: GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd HTTP/1.1 Jun 14 18:28:12.067736 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept: application/json Jun 14 18:28:12.067736 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept-Encoding: identity Jun 14 18:28:12.067736 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Connection: close Jun 14 18:28:12.067736 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Length: 0 Jun 14 18:28:12.067736 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Type: application/json Jun 14 18:28:12.067736 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Host: 10.222.0.78 Jun 14 18:28:12.067736 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Openstack-System-Scope: None Jun 14 18:28:12.067736 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: User-Agent: python-urllib3/1.26.9 Jun 14 18:28:12.067736 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Auth-Token: gAAAAABiqNL0HA3J9yOboSXhrS0Xc3T7l11UJrogKzZ0yp1gI68Y0h9mUZh1z3tL4JQzWF6Yg4Pv5J7X5qCMxINrvvwAmBrYgye8zJukoT5YzoNd8Q9sN62bfwLhXpHL9H_07bWDmwytlxpvn6HpgT10l1zetsXtoUjD6Hh1lAmFk1Z0vLN9rWw Jun 14 18:28:12.067736 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Id: None Jun 14 18:28:12.067736 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Name: None Jun 14 18:28:12.067736 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Identity-Status: Confirmed Jun 14 18:28:12.067736 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Is-Admin-Project: True Jun 14 18:28:12.067736 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Id: default Jun 14 18:28:12.067736 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Name: Default Jun 14 18:28:12.067736 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Id: 3ea8b1ec08d6485ab1ac360549789d2b Jun 14 18:28:12.067736 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Name: tempest-DeleteServersTestJSON-573905821 Jun 14 18:28:12.067736 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Role: reader,member Jun 14 18:28:12.067736 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Roles: reader,member Jun 14 18:28:12.069094 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3ea8b1ec08d6485ab1ac360549789d2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3ea8b1ec08d6485ab1ac360549789d2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3ea8b1ec08d6485ab1ac360549789d2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3ea8b1ec08d6485ab1ac360549789d2b"}]}] Jun 14 18:28:12.069094 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant: tempest-DeleteServersTestJSON-573905821 Jun 14 18:28:12.069094 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Id: 3ea8b1ec08d6485ab1ac360549789d2b Jun 14 18:28:12.069094 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Name: tempest-DeleteServersTestJSON-573905821 Jun 14 18:28:12.069094 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User: tempest-DeleteServersTestJSON-573905821-project Jun 14 18:28:12.069094 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Id: default Jun 14 18:28:12.069094 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Name: Default Jun 14 18:28:12.069094 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Id: 419d0cc6ca7e426cb28257b32037901d Jun 14 18:28:12.069094 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Name: tempest-DeleteServersTestJSON-573905821-project Jun 14 18:28:12.069094 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: method: > Jun 14 18:28:12.069094 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: exception: Instance 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd could not be found. Jun 14 18:28:12.069094 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: action_args: {'id': '3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd'} Jun 14 18:28:12.069912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:28:12.069912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:28:12.069912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:28:12.069912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:28:12.069912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:28:12.069912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:28:12.069912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:28:12.069912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:28:12.069912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:28:12.069912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:28:12.069912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd could not be found. Jun 14 18:28:12.069912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:28:12.069912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:28:12.069912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:28:12.069912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:28:12.069912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:28:12.069912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:28:12.069912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:28:12.069912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:28:12.069912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:28:12.070988 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:28:12.070988 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:28:12.070988 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:28:12.070988 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:28:12.070988 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:28:12.070988 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:28:12.070988 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:28:12.070988 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd could not be found. Jun 14 18:28:12.070988 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:28:12.070988 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:28:12.070988 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:28:12.070988 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:28:12.070988 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:28:12.070988 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:28:12.070988 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:28:12.070988 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:28:12.070988 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd could not be found. Jun 14 18:28:12.070988 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:28:12.072034 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-d118d4cc-b9bb-41aa-8a36-bfbe3075621a tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Returning 404 to user: Instance 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd could not be found. {{(pid=118623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:28:12.072034 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-d118d4cc-b9bb-41aa-8a36-bfbe3075621a tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] 10.222.0.78 "GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd" status: 404 len: 111 microversion: 2.1 time: 0.033506 Jun 14 18:28:12.072034 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 75/158] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:12 2022] GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:28:12.142059 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-3d88a8ee-03e5-47d2-aa0f-3fc1d7d9c1e9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:12.142752 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-3d88a8ee-03e5-47d2-aa0f-3fc1d7d9c1e9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:12.149910 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3d88a8ee-03e5-47d2-aa0f-3fc1d7d9c1e9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:12.150859 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3d88a8ee-03e5-47d2-aa0f-3fc1d7d9c1e9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:12.152550 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3d88a8ee-03e5-47d2-aa0f-3fc1d7d9c1e9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:12.153120 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3d88a8ee-03e5-47d2-aa0f-3fc1d7d9c1e9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:12.173625 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:28:12.244215 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-7659d4cb-9a1c-4431-9dd5-c291e623c48c tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:12.245456 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-7659d4cb-9a1c-4431-9dd5-c291e623c48c tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] [instance: 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:12.252076 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7659d4cb-9a1c-4431-9dd5-c291e623c48c tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:12.252528 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7659d4cb-9a1c-4431-9dd5-c291e623c48c tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:12.253292 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7659d4cb-9a1c-4431-9dd5-c291e623c48c tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:12.253770 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7659d4cb-9a1c-4431-9dd5-c291e623c48c tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:12.269204 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.wsgi [None req-7659d4cb-9a1c-4431-9dd5-c291e623c48c tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] HTTP exception thrown: Instance 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd could not be found. Jun 14 18:28:12.271129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-7659d4cb-9a1c-4431-9dd5-c291e623c48c tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Request method failure captured: Jun 14 18:28:12.271129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: request: GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd/os-volume_attachments HTTP/1.1 Jun 14 18:28:12.271129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept: application/json Jun 14 18:28:12.271129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept-Encoding: identity Jun 14 18:28:12.271129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Connection: close Jun 14 18:28:12.271129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Length: 0 Jun 14 18:28:12.271129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Type: application/json Jun 14 18:28:12.271129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Host: 10.222.0.78 Jun 14 18:28:12.271129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Openstack-System-Scope: None Jun 14 18:28:12.271129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: User-Agent: python-urllib3/1.26.9 Jun 14 18:28:12.271129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Auth-Token: gAAAAABiqNL0HA3J9yOboSXhrS0Xc3T7l11UJrogKzZ0yp1gI68Y0h9mUZh1z3tL4JQzWF6Yg4Pv5J7X5qCMxINrvvwAmBrYgye8zJukoT5YzoNd8Q9sN62bfwLhXpHL9H_07bWDmwytlxpvn6HpgT10l1zetsXtoUjD6Hh1lAmFk1Z0vLN9rWw Jun 14 18:28:12.271129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Id: None Jun 14 18:28:12.271129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Name: None Jun 14 18:28:12.271129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Identity-Status: Confirmed Jun 14 18:28:12.271129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Is-Admin-Project: True Jun 14 18:28:12.271129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Id: default Jun 14 18:28:12.271129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Name: Default Jun 14 18:28:12.271129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Id: 3ea8b1ec08d6485ab1ac360549789d2b Jun 14 18:28:12.271129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Name: tempest-DeleteServersTestJSON-573905821 Jun 14 18:28:12.271129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Role: reader,member Jun 14 18:28:12.271129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Roles: reader,member Jun 14 18:28:12.272331 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3ea8b1ec08d6485ab1ac360549789d2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3ea8b1ec08d6485ab1ac360549789d2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3ea8b1ec08d6485ab1ac360549789d2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3ea8b1ec08d6485ab1ac360549789d2b"}]}] Jun 14 18:28:12.272331 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant: tempest-DeleteServersTestJSON-573905821 Jun 14 18:28:12.272331 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Id: 3ea8b1ec08d6485ab1ac360549789d2b Jun 14 18:28:12.272331 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Name: tempest-DeleteServersTestJSON-573905821 Jun 14 18:28:12.272331 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User: tempest-DeleteServersTestJSON-573905821-project Jun 14 18:28:12.272331 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Id: default Jun 14 18:28:12.272331 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Name: Default Jun 14 18:28:12.272331 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Id: 419d0cc6ca7e426cb28257b32037901d Jun 14 18:28:12.272331 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Name: tempest-DeleteServersTestJSON-573905821-project Jun 14 18:28:12.272331 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: method: > Jun 14 18:28:12.272331 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: exception: Instance 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd could not be found. Jun 14 18:28:12.272331 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: action_args: {'server_id': '3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd'} Jun 14 18:28:12.272950 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:28:12.272950 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:28:12.272950 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:28:12.272950 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:28:12.272950 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:28:12.272950 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:28:12.272950 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:28:12.272950 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:28:12.272950 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:28:12.272950 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:28:12.272950 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd could not be found. Jun 14 18:28:12.272950 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:28:12.272950 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:28:12.272950 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:28:12.272950 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:28:12.272950 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:28:12.272950 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:28:12.272950 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:28:12.272950 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:28:12.272950 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:28:12.274032 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:28:12.274032 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 14 18:28:12.274032 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 14 18:28:12.274032 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 14 18:28:12.274032 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 14 18:28:12.274032 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 14 18:28:12.274032 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 14 18:28:12.274032 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:28:12.274032 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:28:12.274032 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd could not be found. Jun 14 18:28:12.274032 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:28:12.274032 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:28:12.274032 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:28:12.274032 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:28:12.274032 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:28:12.274032 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:28:12.274032 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:28:12.274032 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:28:12.274032 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd could not be found. Jun 14 18:28:12.274032 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:28:12.275303 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-7659d4cb-9a1c-4431-9dd5-c291e623c48c tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Returning 404 to user: Instance 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd could not be found. {{(pid=118623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:28:12.275303 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-7659d4cb-9a1c-4431-9dd5-c291e623c48c tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] 10.222.0.78 "GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032286 Jun 14 18:28:12.275303 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 76/159] 10.222.0.78 () {58 vars in 1301 bytes} [Tue Jun 14 18:28:12 2022] GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 14 18:28:12.296603 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-3d88a8ee-03e5-47d2-aa0f-3fc1d7d9c1e9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:12.304114 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-3d88a8ee-03e5-47d2-aa0f-3fc1d7d9c1e9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1521 microversion: 2.1 time: 0.166150 Jun 14 18:28:12.304994 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 84/160] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:12 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:13.320326 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-d66590c9-ecd7-4934-883e-3b19752768ef tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:13.320926 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-d66590c9-ecd7-4934-883e-3b19752768ef tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:13.327713 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d66590c9-ecd7-4934-883e-3b19752768ef tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:13.328169 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d66590c9-ecd7-4934-883e-3b19752768ef tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:13.328928 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d66590c9-ecd7-4934-883e-3b19752768ef tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:13.329473 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d66590c9-ecd7-4934-883e-3b19752768ef tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:13.344596 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:28:13.461046 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-d66590c9-ecd7-4934-883e-3b19752768ef tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:13.468747 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-d66590c9-ecd7-4934-883e-3b19752768ef tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1521 microversion: 2.1 time: 0.152423 Jun 14 18:28:13.469331 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 77/161] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:13 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:14.486418 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-401df356-9e28-459e-9157-3aec8621b1ac tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:14.487016 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-401df356-9e28-459e-9157-3aec8621b1ac tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:14.494154 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-401df356-9e28-459e-9157-3aec8621b1ac tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:14.494596 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-401df356-9e28-459e-9157-3aec8621b1ac tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:14.495342 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-401df356-9e28-459e-9157-3aec8621b1ac tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:14.495787 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-401df356-9e28-459e-9157-3aec8621b1ac tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:14.627873 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-401df356-9e28-459e-9157-3aec8621b1ac tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:14.635377 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-401df356-9e28-459e-9157-3aec8621b1ac tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1521 microversion: 2.1 time: 0.152931 Jun 14 18:28:14.635942 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 85/162] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:14 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:15.654568 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-b7422743-2a20-40dc-ae57-1ee85e4b909c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:15.655322 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-b7422743-2a20-40dc-ae57-1ee85e4b909c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:15.662089 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b7422743-2a20-40dc-ae57-1ee85e4b909c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:15.662536 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b7422743-2a20-40dc-ae57-1ee85e4b909c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:15.663296 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b7422743-2a20-40dc-ae57-1ee85e4b909c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:15.663729 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b7422743-2a20-40dc-ae57-1ee85e4b909c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:15.804961 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-b7422743-2a20-40dc-ae57-1ee85e4b909c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:15.816548 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-b7422743-2a20-40dc-ae57-1ee85e4b909c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1521 microversion: 2.1 time: 0.164737 Jun 14 18:28:15.816548 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 78/163] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:15 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:16.834813 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-3a494284-061d-40be-91f3-3b64e63ec2ec tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:16.835561 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-3a494284-061d-40be-91f3-3b64e63ec2ec tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:16.843025 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3a494284-061d-40be-91f3-3b64e63ec2ec tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:16.843478 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3a494284-061d-40be-91f3-3b64e63ec2ec tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:16.844278 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3a494284-061d-40be-91f3-3b64e63ec2ec tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:16.844760 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3a494284-061d-40be-91f3-3b64e63ec2ec tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:16.989101 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-3a494284-061d-40be-91f3-3b64e63ec2ec tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:16.997043 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-3a494284-061d-40be-91f3-3b64e63ec2ec tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1521 microversion: 2.1 time: 0.168599 Jun 14 18:28:16.997648 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 86/164] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:16 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:18.014715 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-5d38f393-056b-476e-9149-6b26292b6f2d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:18.015319 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-5d38f393-056b-476e-9149-6b26292b6f2d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:18.021946 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5d38f393-056b-476e-9149-6b26292b6f2d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:18.022400 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5d38f393-056b-476e-9149-6b26292b6f2d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:18.023169 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5d38f393-056b-476e-9149-6b26292b6f2d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:18.023607 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5d38f393-056b-476e-9149-6b26292b6f2d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:18.155801 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-5d38f393-056b-476e-9149-6b26292b6f2d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:18.163395 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-5d38f393-056b-476e-9149-6b26292b6f2d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1521 microversion: 2.1 time: 0.153647 Jun 14 18:28:18.163967 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 79/165] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:18 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:19.181084 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-70a7834c-7218-4684-82a3-35ea7fbc9e42 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:19.181721 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-70a7834c-7218-4684-82a3-35ea7fbc9e42 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:19.188401 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-70a7834c-7218-4684-82a3-35ea7fbc9e42 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:19.188839 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-70a7834c-7218-4684-82a3-35ea7fbc9e42 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:19.189622 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-70a7834c-7218-4684-82a3-35ea7fbc9e42 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:19.190051 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-70a7834c-7218-4684-82a3-35ea7fbc9e42 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:19.335924 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-70a7834c-7218-4684-82a3-35ea7fbc9e42 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:19.343980 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-70a7834c-7218-4684-82a3-35ea7fbc9e42 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1521 microversion: 2.1 time: 0.166655 Jun 14 18:28:19.344541 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 87/166] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:19 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:20.361611 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-42ffa2e4-6583-48e3-ab63-d75bcd5acf33 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:20.362426 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-42ffa2e4-6583-48e3-ab63-d75bcd5acf33 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:20.369082 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-42ffa2e4-6583-48e3-ab63-d75bcd5acf33 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:20.369635 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-42ffa2e4-6583-48e3-ab63-d75bcd5acf33 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:20.371239 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-42ffa2e4-6583-48e3-ab63-d75bcd5acf33 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:20.371532 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-42ffa2e4-6583-48e3-ab63-d75bcd5acf33 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:20.573242 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-42ffa2e4-6583-48e3-ab63-d75bcd5acf33 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:20.581743 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-42ffa2e4-6583-48e3-ab63-d75bcd5acf33 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1521 microversion: 2.1 time: 0.225025 Jun 14 18:28:20.582417 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 80/167] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:20 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:21.600682 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-c8c36d81-5f7c-4469-b8e2-487ada0de281 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:21.601789 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-c8c36d81-5f7c-4469-b8e2-487ada0de281 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:21.610292 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c8c36d81-5f7c-4469-b8e2-487ada0de281 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:21.610744 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c8c36d81-5f7c-4469-b8e2-487ada0de281 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:21.611926 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c8c36d81-5f7c-4469-b8e2-487ada0de281 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:21.612356 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c8c36d81-5f7c-4469-b8e2-487ada0de281 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:21.750350 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-c8c36d81-5f7c-4469-b8e2-487ada0de281 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:21.763878 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-c8c36d81-5f7c-4469-b8e2-487ada0de281 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1521 microversion: 2.1 time: 0.167679 Jun 14 18:28:21.764358 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 88/168] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:21 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:22.439656 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-7ca03929-4279-4e24-a3c9-b210429b79d6 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:22.440139 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-7ca03929-4279-4e24-a3c9-b210429b79d6 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] [instance: 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:22.446416 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7ca03929-4279-4e24-a3c9-b210429b79d6 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:22.446868 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7ca03929-4279-4e24-a3c9-b210429b79d6 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:22.447628 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7ca03929-4279-4e24-a3c9-b210429b79d6 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:22.448062 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7ca03929-4279-4e24-a3c9-b210429b79d6 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:22.463861 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.wsgi [None req-7ca03929-4279-4e24-a3c9-b210429b79d6 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] HTTP exception thrown: Instance 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd could not be found. Jun 14 18:28:22.466464 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-7ca03929-4279-4e24-a3c9-b210429b79d6 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Request method failure captured: Jun 14 18:28:22.466464 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: request: DELETE /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd HTTP/1.1 Jun 14 18:28:22.466464 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept: application/json Jun 14 18:28:22.466464 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept-Encoding: identity Jun 14 18:28:22.466464 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Connection: close Jun 14 18:28:22.466464 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Length: 0 Jun 14 18:28:22.466464 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Type: application/json Jun 14 18:28:22.466464 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Host: 10.222.0.78 Jun 14 18:28:22.466464 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Openstack-System-Scope: None Jun 14 18:28:22.466464 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: User-Agent: python-urllib3/1.26.9 Jun 14 18:28:22.466464 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Auth-Token: gAAAAABiqNL0HA3J9yOboSXhrS0Xc3T7l11UJrogKzZ0yp1gI68Y0h9mUZh1z3tL4JQzWF6Yg4Pv5J7X5qCMxINrvvwAmBrYgye8zJukoT5YzoNd8Q9sN62bfwLhXpHL9H_07bWDmwytlxpvn6HpgT10l1zetsXtoUjD6Hh1lAmFk1Z0vLN9rWw Jun 14 18:28:22.466464 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Id: None Jun 14 18:28:22.466464 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Name: None Jun 14 18:28:22.466464 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Identity-Status: Confirmed Jun 14 18:28:22.466464 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Is-Admin-Project: True Jun 14 18:28:22.466464 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Id: default Jun 14 18:28:22.466464 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Name: Default Jun 14 18:28:22.466464 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Id: 3ea8b1ec08d6485ab1ac360549789d2b Jun 14 18:28:22.466464 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Name: tempest-DeleteServersTestJSON-573905821 Jun 14 18:28:22.466464 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Role: reader,member Jun 14 18:28:22.466464 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Roles: reader,member Jun 14 18:28:22.467829 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3ea8b1ec08d6485ab1ac360549789d2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3ea8b1ec08d6485ab1ac360549789d2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3ea8b1ec08d6485ab1ac360549789d2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3ea8b1ec08d6485ab1ac360549789d2b"}]}] Jun 14 18:28:22.467829 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant: tempest-DeleteServersTestJSON-573905821 Jun 14 18:28:22.467829 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Id: 3ea8b1ec08d6485ab1ac360549789d2b Jun 14 18:28:22.467829 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Name: tempest-DeleteServersTestJSON-573905821 Jun 14 18:28:22.467829 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User: tempest-DeleteServersTestJSON-573905821-project Jun 14 18:28:22.467829 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Id: default Jun 14 18:28:22.467829 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Name: Default Jun 14 18:28:22.467829 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Id: 419d0cc6ca7e426cb28257b32037901d Jun 14 18:28:22.467829 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Name: tempest-DeleteServersTestJSON-573905821-project Jun 14 18:28:22.467829 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: method: > Jun 14 18:28:22.467829 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: exception: Instance 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd could not be found. Jun 14 18:28:22.467829 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: action_args: {'id': '3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd'} Jun 14 18:28:22.468669 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:28:22.468669 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:28:22.468669 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:28:22.468669 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:28:22.468669 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:28:22.468669 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:28:22.468669 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:28:22.468669 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:28:22.468669 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:28:22.468669 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:28:22.468669 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd could not be found. Jun 14 18:28:22.468669 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:28:22.468669 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:28:22.468669 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:28:22.468669 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:28:22.468669 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:28:22.468669 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:28:22.468669 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:28:22.468669 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:28:22.468669 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:28:22.469965 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:28:22.469965 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 14 18:28:22.469965 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 14 18:28:22.469965 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 14 18:28:22.469965 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 14 18:28:22.469965 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:28:22.469965 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:28:22.469965 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:28:22.469965 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:28:22.469965 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd could not be found. Jun 14 18:28:22.469965 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:28:22.469965 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:28:22.469965 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:28:22.469965 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:28:22.469965 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:28:22.469965 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:28:22.469965 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:28:22.469965 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:28:22.469965 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd could not be found. Jun 14 18:28:22.469965 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:28:22.471190 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-7ca03929-4279-4e24-a3c9-b210429b79d6 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Returning 404 to user: Instance 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd could not be found. {{(pid=118623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:28:22.471190 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-7ca03929-4279-4e24-a3c9-b210429b79d6 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd" status: 404 len: 111 microversion: 2.1 time: 0.035082 Jun 14 18:28:22.471579 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 81/169] 10.222.0.78 () {58 vars in 1238 bytes} [Tue Jun 14 18:28:22 2022] DELETE /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:28:22.480722 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-63162f08-ac7c-4a92-aebf-751b8014d228 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:22.481423 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-63162f08-ac7c-4a92-aebf-751b8014d228 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] [instance: 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:22.488230 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-63162f08-ac7c-4a92-aebf-751b8014d228 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:22.488685 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-63162f08-ac7c-4a92-aebf-751b8014d228 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:22.489470 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-63162f08-ac7c-4a92-aebf-751b8014d228 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:22.489908 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-63162f08-ac7c-4a92-aebf-751b8014d228 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:22.512402 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.wsgi [None req-63162f08-ac7c-4a92-aebf-751b8014d228 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] HTTP exception thrown: Instance 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd could not be found. Jun 14 18:28:22.517643 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-63162f08-ac7c-4a92-aebf-751b8014d228 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Request method failure captured: Jun 14 18:28:22.517643 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: request: GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd HTTP/1.1 Jun 14 18:28:22.517643 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept: application/json Jun 14 18:28:22.517643 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept-Encoding: identity Jun 14 18:28:22.517643 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Connection: close Jun 14 18:28:22.517643 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Length: 0 Jun 14 18:28:22.517643 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Type: application/json Jun 14 18:28:22.517643 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Host: 10.222.0.78 Jun 14 18:28:22.517643 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Openstack-System-Scope: None Jun 14 18:28:22.517643 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: User-Agent: python-urllib3/1.26.9 Jun 14 18:28:22.517643 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Auth-Token: gAAAAABiqNL0HA3J9yOboSXhrS0Xc3T7l11UJrogKzZ0yp1gI68Y0h9mUZh1z3tL4JQzWF6Yg4Pv5J7X5qCMxINrvvwAmBrYgye8zJukoT5YzoNd8Q9sN62bfwLhXpHL9H_07bWDmwytlxpvn6HpgT10l1zetsXtoUjD6Hh1lAmFk1Z0vLN9rWw Jun 14 18:28:22.517643 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Id: None Jun 14 18:28:22.517643 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Name: None Jun 14 18:28:22.517643 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Identity-Status: Confirmed Jun 14 18:28:22.517643 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Is-Admin-Project: True Jun 14 18:28:22.517643 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Id: default Jun 14 18:28:22.517643 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Name: Default Jun 14 18:28:22.517643 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Id: 3ea8b1ec08d6485ab1ac360549789d2b Jun 14 18:28:22.517643 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Name: tempest-DeleteServersTestJSON-573905821 Jun 14 18:28:22.517643 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Role: reader,member Jun 14 18:28:22.517643 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Roles: reader,member Jun 14 18:28:22.518966 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3ea8b1ec08d6485ab1ac360549789d2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3ea8b1ec08d6485ab1ac360549789d2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3ea8b1ec08d6485ab1ac360549789d2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3ea8b1ec08d6485ab1ac360549789d2b"}]}] Jun 14 18:28:22.518966 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant: tempest-DeleteServersTestJSON-573905821 Jun 14 18:28:22.518966 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Id: 3ea8b1ec08d6485ab1ac360549789d2b Jun 14 18:28:22.518966 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Name: tempest-DeleteServersTestJSON-573905821 Jun 14 18:28:22.518966 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User: tempest-DeleteServersTestJSON-573905821-project Jun 14 18:28:22.518966 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Id: default Jun 14 18:28:22.518966 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Name: Default Jun 14 18:28:22.518966 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Id: 419d0cc6ca7e426cb28257b32037901d Jun 14 18:28:22.518966 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Name: tempest-DeleteServersTestJSON-573905821-project Jun 14 18:28:22.518966 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: method: > Jun 14 18:28:22.518966 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: exception: Instance 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd could not be found. Jun 14 18:28:22.518966 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: action_args: {'id': '3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd'} Jun 14 18:28:22.519668 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:28:22.519668 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:28:22.519668 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:28:22.519668 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:28:22.519668 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:28:22.519668 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:28:22.519668 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:28:22.519668 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:28:22.519668 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:28:22.519668 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:28:22.519668 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd could not be found. Jun 14 18:28:22.519668 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:28:22.519668 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:28:22.519668 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:28:22.519668 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:28:22.519668 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:28:22.519668 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:28:22.519668 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:28:22.519668 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:28:22.519668 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:28:22.526896 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:28:22.526896 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:28:22.526896 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:28:22.526896 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:28:22.526896 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:28:22.526896 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:28:22.526896 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:28:22.526896 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd could not be found. Jun 14 18:28:22.526896 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:28:22.526896 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:28:22.526896 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:28:22.526896 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:28:22.526896 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:28:22.526896 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:28:22.526896 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:28:22.526896 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:28:22.526896 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd could not be found. Jun 14 18:28:22.526896 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:28:22.530710 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-63162f08-ac7c-4a92-aebf-751b8014d228 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] Returning 404 to user: Instance 3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd could not be found. {{(pid=118624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:28:22.530710 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-63162f08-ac7c-4a92-aebf-751b8014d228 tempest-DeleteServersTestJSON-573905821 tempest-DeleteServersTestJSON-573905821-project] 10.222.0.78 "GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd" status: 404 len: 111 microversion: 2.1 time: 0.043273 Jun 14 18:28:22.530710 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 89/170] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:22 2022] GET /compute/v2.1/servers/3c972e47-ce4c-4eb9-bcdb-5a6f252b2dcd => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:28:22.780916 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-e4e54b65-aa8f-40a6-a807-0715f0f3b813 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:22.781595 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-e4e54b65-aa8f-40a6-a807-0715f0f3b813 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:22.788566 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e4e54b65-aa8f-40a6-a807-0715f0f3b813 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:22.788888 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e4e54b65-aa8f-40a6-a807-0715f0f3b813 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:22.789690 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e4e54b65-aa8f-40a6-a807-0715f0f3b813 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:22.790162 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e4e54b65-aa8f-40a6-a807-0715f0f3b813 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:22.983526 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-e4e54b65-aa8f-40a6-a807-0715f0f3b813 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:22.991009 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-e4e54b65-aa8f-40a6-a807-0715f0f3b813 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1521 microversion: 2.1 time: 0.213978 Jun 14 18:28:22.991997 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 82/171] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:22 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:24.008252 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-a4ea8447-d78d-43de-b301-ad58b63be05d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:24.009051 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-a4ea8447-d78d-43de-b301-ad58b63be05d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:24.016028 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a4ea8447-d78d-43de-b301-ad58b63be05d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:24.016504 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a4ea8447-d78d-43de-b301-ad58b63be05d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:24.017248 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a4ea8447-d78d-43de-b301-ad58b63be05d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:24.017706 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a4ea8447-d78d-43de-b301-ad58b63be05d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:24.204159 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-a4ea8447-d78d-43de-b301-ad58b63be05d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:24.211976 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-a4ea8447-d78d-43de-b301-ad58b63be05d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1521 microversion: 2.1 time: 0.207548 Jun 14 18:28:24.212557 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 90/172] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:24 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:28:25.229255 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-617e4ee6-af92-4099-976c-f187c31c15b9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:25.229916 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-617e4ee6-af92-4099-976c-f187c31c15b9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:25.236008 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-617e4ee6-af92-4099-976c-f187c31c15b9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:25.236464 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-617e4ee6-af92-4099-976c-f187c31c15b9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:25.237225 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-617e4ee6-af92-4099-976c-f187c31c15b9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:25.237688 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-617e4ee6-af92-4099-976c-f187c31c15b9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:25.374090 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-617e4ee6-af92-4099-976c-f187c31c15b9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:25.382413 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-617e4ee6-af92-4099-976c-f187c31c15b9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1521 microversion: 2.1 time: 0.156859 Jun 14 18:28:25.393871 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 83/173] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:25 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:26.400079 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-e9ba83ed-21b2-4529-9d0e-cf245130fba0 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:26.400877 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-e9ba83ed-21b2-4529-9d0e-cf245130fba0 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:26.408219 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e9ba83ed-21b2-4529-9d0e-cf245130fba0 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:26.408672 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e9ba83ed-21b2-4529-9d0e-cf245130fba0 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:26.409481 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e9ba83ed-21b2-4529-9d0e-cf245130fba0 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:26.409913 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e9ba83ed-21b2-4529-9d0e-cf245130fba0 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:26.618637 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-e9ba83ed-21b2-4529-9d0e-cf245130fba0 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:26.626953 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-e9ba83ed-21b2-4529-9d0e-cf245130fba0 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1521 microversion: 2.1 time: 0.230891 Jun 14 18:28:26.627733 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 91/174] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:26 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:27.650901 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-e5ab4878-576f-4b30-82c6-64193180e4e8 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:27.651522 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-e5ab4878-576f-4b30-82c6-64193180e4e8 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:27.660690 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e5ab4878-576f-4b30-82c6-64193180e4e8 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:27.661518 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e5ab4878-576f-4b30-82c6-64193180e4e8 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:27.662453 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e5ab4878-576f-4b30-82c6-64193180e4e8 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:27.663173 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e5ab4878-576f-4b30-82c6-64193180e4e8 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:27.888902 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-e5ab4878-576f-4b30-82c6-64193180e4e8 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:27.899434 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-e5ab4878-576f-4b30-82c6-64193180e4e8 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1521 microversion: 2.1 time: 0.252231 Jun 14 18:28:27.900193 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 84/175] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:27 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:28.917670 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-3886c11b-7755-4f7b-85f0-2073b2142c2f tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:28.918956 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-3886c11b-7755-4f7b-85f0-2073b2142c2f tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:28.922549 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:28:28.937267 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3886c11b-7755-4f7b-85f0-2073b2142c2f tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:28.938870 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3886c11b-7755-4f7b-85f0-2073b2142c2f tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:28.941031 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3886c11b-7755-4f7b-85f0-2073b2142c2f tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:28.941766 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3886c11b-7755-4f7b-85f0-2073b2142c2f tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:29.243453 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-3886c11b-7755-4f7b-85f0-2073b2142c2f tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:29.254545 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-3886c11b-7755-4f7b-85f0-2073b2142c2f tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1521 microversion: 2.1 time: 0.340947 Jun 14 18:28:29.255120 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 92/176] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:28 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1521 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:30.273490 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-eeb363d1-2275-4b47-a10a-e3d4caaec220 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:30.274398 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-eeb363d1-2275-4b47-a10a-e3d4caaec220 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:30.286959 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_api:SELECT=52 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:28:30.288840 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-eeb363d1-2275-4b47-a10a-e3d4caaec220 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:30.293791 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-eeb363d1-2275-4b47-a10a-e3d4caaec220 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:30.298412 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-eeb363d1-2275-4b47-a10a-e3d4caaec220 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:30.299467 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-eeb363d1-2275-4b47-a10a-e3d4caaec220 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:30.535294 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-eeb363d1-2275-4b47-a10a-e3d4caaec220 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:30.546082 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-eeb363d1-2275-4b47-a10a-e3d4caaec220 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1521 microversion: 2.1 time: 0.278060 Jun 14 18:28:30.556543 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 85/177] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:30 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:31.568472 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-700cfd78-cc36-497a-b4d6-38723bc31e6e tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:31.569053 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-700cfd78-cc36-497a-b4d6-38723bc31e6e tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:31.583474 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-700cfd78-cc36-497a-b4d6-38723bc31e6e tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:31.583947 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-700cfd78-cc36-497a-b4d6-38723bc31e6e tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:31.584757 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-700cfd78-cc36-497a-b4d6-38723bc31e6e tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:31.585198 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-700cfd78-cc36-497a-b4d6-38723bc31e6e tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:31.913563 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-700cfd78-cc36-497a-b4d6-38723bc31e6e tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:31.928049 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-700cfd78-cc36-497a-b4d6-38723bc31e6e tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1521 microversion: 2.1 time: 0.365867 Jun 14 18:28:31.929746 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 93/178] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:31 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1521 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:32.955196 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-9c4f4cd4-c341-4a3a-84ff-5a017b9296ea tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:32.956395 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-9c4f4cd4-c341-4a3a-84ff-5a017b9296ea tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:32.969196 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9c4f4cd4-c341-4a3a-84ff-5a017b9296ea tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:32.969736 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9c4f4cd4-c341-4a3a-84ff-5a017b9296ea tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:32.970781 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9c4f4cd4-c341-4a3a-84ff-5a017b9296ea tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:32.971434 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9c4f4cd4-c341-4a3a-84ff-5a017b9296ea tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:33.187909 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-9c4f4cd4-c341-4a3a-84ff-5a017b9296ea tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:33.196525 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-9c4f4cd4-c341-4a3a-84ff-5a017b9296ea tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1521 microversion: 2.1 time: 0.251195 Jun 14 18:28:33.197601 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 86/179] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:32 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:33.342642 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-4f87359c-ed80-408c-b254-fa9c98f2f235 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Action: 'create', calling method: .version_select at 0x7efe70f1d9d0>, body: {"keypair": {"name": "tempest-keypair-412435349", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWmWWwZSwI0OodwM0u9I4xJiYZKVOxLA2Tw0Zl996oqlfKrp+2+3w+wBIf0Yia9MGCp1o/BWRiui2q1VTAZKQpQAmVKh2ius8VNV21okgQ5o5tgIsMujufZKbFxYssKXQ=="}} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:28:33.363910 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.quota [None req-4f87359c-ed80-408c-b254-fa9c98f2f235 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Getting quotas for project 56f8367a52044e82a2c272da39e1bfd8. Resources: {'key_pairs'} {{(pid=118624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:28:33.369158 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.quota [None req-4f87359c-ed80-408c-b254-fa9c98f2f235 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Getting quotas for user 9254bd46822346009497b01d28314335 and project 56f8367a52044e82a2c272da39e1bfd8. Resources: {'key_pairs'} {{(pid=118624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:28:33.546434 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-4f87359c-ed80-408c-b254-fa9c98f2f235 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.385442 Jun 14 18:28:33.547227 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 94/180] 10.222.0.78 () {60 vars in 1158 bytes} [Tue Jun 14 18:28:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:28:34.216060 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-a04c1989-a922-4b2b-9f74-eea181cc07e3 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:34.217233 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-a04c1989-a922-4b2b-9f74-eea181cc07e3 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:34.223592 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a04c1989-a922-4b2b-9f74-eea181cc07e3 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:34.224041 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a04c1989-a922-4b2b-9f74-eea181cc07e3 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:34.224806 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a04c1989-a922-4b2b-9f74-eea181cc07e3 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:34.225235 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a04c1989-a922-4b2b-9f74-eea181cc07e3 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:34.424735 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-a04c1989-a922-4b2b-9f74-eea181cc07e3 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:34.436617 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-a04c1989-a922-4b2b-9f74-eea181cc07e3 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1521 microversion: 2.1 time: 0.225157 Jun 14 18:28:34.450966 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 87/181] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:34 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:35.465766 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-29a40fec-9687-4713-98c3-a7d0cf263655 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:35.466401 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-29a40fec-9687-4713-98c3-a7d0cf263655 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:35.485790 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-29a40fec-9687-4713-98c3-a7d0cf263655 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:35.485790 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-29a40fec-9687-4713-98c3-a7d0cf263655 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:35.485790 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-29a40fec-9687-4713-98c3-a7d0cf263655 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:35.485790 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-29a40fec-9687-4713-98c3-a7d0cf263655 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:35.692161 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-29a40fec-9687-4713-98c3-a7d0cf263655 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:35.703144 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-29a40fec-9687-4713-98c3-a7d0cf263655 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1521 microversion: 2.1 time: 0.241785 Jun 14 18:28:35.703144 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 95/182] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:35 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:36.724016 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-c0311bcc-354b-4ae6-a7b5-560d86afeed4 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:36.724518 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-c0311bcc-354b-4ae6-a7b5-560d86afeed4 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:36.730937 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c0311bcc-354b-4ae6-a7b5-560d86afeed4 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:36.731486 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c0311bcc-354b-4ae6-a7b5-560d86afeed4 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:36.733807 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c0311bcc-354b-4ae6-a7b5-560d86afeed4 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:36.734208 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c0311bcc-354b-4ae6-a7b5-560d86afeed4 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:36.927320 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-6f5a21eb-a672-44c2-836f-4e09227209f2 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1192417341", "imageRef": "e2555120-8576-4128-944f-40805aa95a9b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e21b4aaa-368c-485d-acb4-337720920cc4"}], "security_groups": [{"name": "tempest-securitygroup--746836016"}], "key_name": "tempest-keypair-412435349", "user_data": "}} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:28:37.034156 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-c0311bcc-354b-4ae6-a7b5-560d86afeed4 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:37.054662 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-c0311bcc-354b-4ae6-a7b5-560d86afeed4 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1521 microversion: 2.1 time: 0.338439 Jun 14 18:28:37.058688 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 88/183] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:36 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1521 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:37.107888 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.network.neutron [None req-6f5a21eb-a672-44c2-836f-4e09227209f2 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] validate_networks() for [('e21b4aaa-368c-485d-acb4-337720920cc4', None, None, None, None, None)] {{(pid=118624) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 18:28:37.574517 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-6f5a21eb-a672-44c2-836f-4e09227209f2 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Flavor limits 0:0:0 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 18:28:37.575031 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-6f5a21eb-a672-44c2-836f-4e09227209f2 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Image limits 0:0:0 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 18:28:37.575502 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-6f5a21eb-a672-44c2-836f-4e09227209f2 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Flavor pref 0:0:0 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 18:28:37.575958 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-6f5a21eb-a672-44c2-836f-4e09227209f2 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Image pref 0:0:0 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 18:28:37.576394 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-6f5a21eb-a672-44c2-836f-4e09227209f2 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 18:28:37.585501 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6f5a21eb-a672-44c2-836f-4e09227209f2 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:37.585952 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6f5a21eb-a672-44c2-836f-4e09227209f2 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:37.586737 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6f5a21eb-a672-44c2-836f-4e09227209f2 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:37.587168 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6f5a21eb-a672-44c2-836f-4e09227209f2 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:37.605735 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.quota [None req-6f5a21eb-a672-44c2-836f-4e09227209f2 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Getting quotas for project 56f8367a52044e82a2c272da39e1bfd8. Resources: {'instances', 'cores', 'ram'} {{(pid=118624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:28:37.609934 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.quota [None req-6f5a21eb-a672-44c2-836f-4e09227209f2 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Getting quotas for user 9254bd46822346009497b01d28314335 and project 56f8367a52044e82a2c272da39e1bfd8. Resources: {'instances', 'cores', 'ram'} {{(pid=118624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:28:37.621380 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-6f5a21eb-a672-44c2-836f-4e09227209f2 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Going to run 1 instances... {{(pid=118624) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 18:28:37.623675 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-6f5a21eb-a672-44c2-836f-4e09227209f2 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 17641e09-70b6-4020-9fb5-31780056f2d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e2555120-8576-4128-944f-40805aa95a9b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118624) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 18:28:37.758820 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-6f5a21eb-a672-44c2-836f-4e09227209f2 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.836567 Jun 14 18:28:37.759473 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 96/184] 10.222.0.78 () {60 vars in 1146 bytes} [Tue Jun 14 18:28:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 18:28:37.770159 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-312fc26e-f693-4dc2-83fd-a137c4052d2c tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:37.778750 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-312fc26e-f693-4dc2-83fd-a137c4052d2c tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 17641e09-70b6-4020-9fb5-31780056f2d9] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:37.836956 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-312fc26e-f693-4dc2-83fd-a137c4052d2c tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:37.847600 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-312fc26e-f693-4dc2-83fd-a137c4052d2c tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9" status: 200 len: 1241 microversion: 2.1 time: 0.081100 Jun 14 18:28:37.848574 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 89/185] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:37 2022] GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9 => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:38.073098 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-191ff74e-1588-47f9-bbed-056d4baf85ac tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:38.074473 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-191ff74e-1588-47f9-bbed-056d4baf85ac tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:38.081324 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-191ff74e-1588-47f9-bbed-056d4baf85ac tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:38.081811 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-191ff74e-1588-47f9-bbed-056d4baf85ac tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:38.082568 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-191ff74e-1588-47f9-bbed-056d4baf85ac tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:38.082997 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-191ff74e-1588-47f9-bbed-056d4baf85ac tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:38.222747 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-191ff74e-1588-47f9-bbed-056d4baf85ac tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:38.237013 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-191ff74e-1588-47f9-bbed-056d4baf85ac tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1521 microversion: 2.1 time: 0.168179 Jun 14 18:28:38.237873 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 97/186] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:38 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:38.864952 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-a0fe74d5-db02-4eab-8468-c61faacdca78 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:38.865650 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-a0fe74d5-db02-4eab-8468-c61faacdca78 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 17641e09-70b6-4020-9fb5-31780056f2d9] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:38.917960 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-a0fe74d5-db02-4eab-8468-c61faacdca78 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:38.925563 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-a0fe74d5-db02-4eab-8468-c61faacdca78 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9" status: 200 len: 1241 microversion: 2.1 time: 0.064518 Jun 14 18:28:38.926401 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 90/187] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:38 2022] GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9 => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:39.254266 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-96a68c14-ae6c-44d7-a8ae-95a7e7323646 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:39.254815 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-96a68c14-ae6c-44d7-a8ae-95a7e7323646 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:39.262452 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-96a68c14-ae6c-44d7-a8ae-95a7e7323646 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:39.262960 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-96a68c14-ae6c-44d7-a8ae-95a7e7323646 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:39.263746 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-96a68c14-ae6c-44d7-a8ae-95a7e7323646 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:39.264183 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-96a68c14-ae6c-44d7-a8ae-95a7e7323646 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:39.392890 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-96a68c14-ae6c-44d7-a8ae-95a7e7323646 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:39.400327 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-96a68c14-ae6c-44d7-a8ae-95a7e7323646 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1521 microversion: 2.1 time: 0.150087 Jun 14 18:28:39.400899 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 98/188] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:39 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:39.943746 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-1fda1251-c80f-47db-a0e6-f01d4adbf746 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:39.944344 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-1fda1251-c80f-47db-a0e6-f01d4adbf746 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 17641e09-70b6-4020-9fb5-31780056f2d9] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:39.951081 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1fda1251-c80f-47db-a0e6-f01d4adbf746 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:39.951527 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1fda1251-c80f-47db-a0e6-f01d4adbf746 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:39.952294 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1fda1251-c80f-47db-a0e6-f01d4adbf746 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:39.952722 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1fda1251-c80f-47db-a0e6-f01d4adbf746 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:40.016098 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-1fda1251-c80f-47db-a0e6-f01d4adbf746 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:40.024020 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-1fda1251-c80f-47db-a0e6-f01d4adbf746 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9" status: 200 len: 1237 microversion: 2.1 time: 0.084198 Jun 14 18:28:40.024592 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 91/189] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:39 2022] GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9 => generated 1237 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:40.418722 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-8e4cbd17-2f37-4c35-9f05-7a0c87bbe0eb tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:40.419550 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-8e4cbd17-2f37-4c35-9f05-7a0c87bbe0eb tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:40.427155 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8e4cbd17-2f37-4c35-9f05-7a0c87bbe0eb tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:40.427663 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8e4cbd17-2f37-4c35-9f05-7a0c87bbe0eb tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:40.428615 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8e4cbd17-2f37-4c35-9f05-7a0c87bbe0eb tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:40.429092 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8e4cbd17-2f37-4c35-9f05-7a0c87bbe0eb tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:40.627306 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-8e4cbd17-2f37-4c35-9f05-7a0c87bbe0eb tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:40.636187 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-8e4cbd17-2f37-4c35-9f05-7a0c87bbe0eb tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1521 microversion: 2.1 time: 0.221735 Jun 14 18:28:40.645907 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 99/190] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:40 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:41.041911 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-39b8b704-dfc9-4a8a-9466-52e860d752d7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:41.043203 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-39b8b704-dfc9-4a8a-9466-52e860d752d7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 17641e09-70b6-4020-9fb5-31780056f2d9] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:41.050852 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-39b8b704-dfc9-4a8a-9466-52e860d752d7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:41.051478 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-39b8b704-dfc9-4a8a-9466-52e860d752d7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:41.052351 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-39b8b704-dfc9-4a8a-9466-52e860d752d7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:41.052942 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-39b8b704-dfc9-4a8a-9466-52e860d752d7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:41.115578 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-39b8b704-dfc9-4a8a-9466-52e860d752d7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:41.126323 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-39b8b704-dfc9-4a8a-9466-52e860d752d7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9" status: 200 len: 1293 microversion: 2.1 time: 0.088663 Jun 14 18:28:41.127139 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 92/191] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:41 2022] GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9 => generated 1293 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:41.653874 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-377acbf7-7ebe-4725-8d23-f68f7e79443d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:41.654663 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-377acbf7-7ebe-4725-8d23-f68f7e79443d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:41.661382 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-377acbf7-7ebe-4725-8d23-f68f7e79443d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:41.661867 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-377acbf7-7ebe-4725-8d23-f68f7e79443d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:41.662640 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-377acbf7-7ebe-4725-8d23-f68f7e79443d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:41.663078 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-377acbf7-7ebe-4725-8d23-f68f7e79443d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:41.813791 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-377acbf7-7ebe-4725-8d23-f68f7e79443d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:41.823115 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-377acbf7-7ebe-4725-8d23-f68f7e79443d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1521 microversion: 2.1 time: 0.173497 Jun 14 18:28:41.823667 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 100/192] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:41 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:42.144143 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-a1939fc0-097c-4003-b116-cc075a40bc12 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:42.144691 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-a1939fc0-097c-4003-b116-cc075a40bc12 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 17641e09-70b6-4020-9fb5-31780056f2d9] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:42.150913 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a1939fc0-097c-4003-b116-cc075a40bc12 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:42.151491 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a1939fc0-097c-4003-b116-cc075a40bc12 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:42.153264 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a1939fc0-097c-4003-b116-cc075a40bc12 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:42.153797 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a1939fc0-097c-4003-b116-cc075a40bc12 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:42.224311 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-a1939fc0-097c-4003-b116-cc075a40bc12 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:42.233874 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-a1939fc0-097c-4003-b116-cc075a40bc12 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9" status: 200 len: 1301 microversion: 2.1 time: 0.093622 Jun 14 18:28:42.234473 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 93/193] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:42 2022] GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9 => generated 1301 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:28:42.849560 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-f6e4cb26-57c9-412a-8a12-66878cbe2235 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:42.850711 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-f6e4cb26-57c9-412a-8a12-66878cbe2235 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:42.859410 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f6e4cb26-57c9-412a-8a12-66878cbe2235 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:42.865153 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f6e4cb26-57c9-412a-8a12-66878cbe2235 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:42.865153 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f6e4cb26-57c9-412a-8a12-66878cbe2235 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:42.865153 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f6e4cb26-57c9-412a-8a12-66878cbe2235 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:43.075462 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-f6e4cb26-57c9-412a-8a12-66878cbe2235 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:43.083043 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-f6e4cb26-57c9-412a-8a12-66878cbe2235 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1501 microversion: 2.1 time: 0.238264 Jun 14 18:28:43.083612 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 101/194] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:42 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1501 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:43.099016 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-28d1822c-0c74-4c30-beab-28ec022f53ec tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:43.101576 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-28d1822c-0c74-4c30-beab-28ec022f53ec tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 99045096-d6ff-4e14-b710-1b1e2dd9a7c5] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:43.106226 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-28d1822c-0c74-4c30-beab-28ec022f53ec tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:43.106674 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-28d1822c-0c74-4c30-beab-28ec022f53ec tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:43.107443 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-28d1822c-0c74-4c30-beab-28ec022f53ec tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:43.107914 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-28d1822c-0c74-4c30-beab-28ec022f53ec tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:43.253285 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-de32b4c1-2eab-4bdf-85dd-b1fa068b7a6f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:43.254015 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-de32b4c1-2eab-4bdf-85dd-b1fa068b7a6f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 17641e09-70b6-4020-9fb5-31780056f2d9] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:43.261817 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-de32b4c1-2eab-4bdf-85dd-b1fa068b7a6f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:43.262361 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-de32b4c1-2eab-4bdf-85dd-b1fa068b7a6f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:43.263318 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-de32b4c1-2eab-4bdf-85dd-b1fa068b7a6f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:43.263763 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-de32b4c1-2eab-4bdf-85dd-b1fa068b7a6f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:43.284273 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-28d1822c-0c74-4c30-beab-28ec022f53ec tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:43.292939 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-28d1822c-0c74-4c30-beab-28ec022f53ec tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5" status: 200 len: 1514 microversion: 2.1 time: 0.197117 Jun 14 18:28:43.305487 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 94/195] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:43 2022] GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5 => generated 1514 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:28:43.359016 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-de32b4c1-2eab-4bdf-85dd-b1fa068b7a6f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:43.378193 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-de32b4c1-2eab-4bdf-85dd-b1fa068b7a6f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9" status: 200 len: 1299 microversion: 2.1 time: 0.120988 Jun 14 18:28:43.378193 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 102/196] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:43 2022] GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9 => generated 1299 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:44.392788 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-c4d65651-e2cf-4afe-89b6-738e8cdb4abd tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:44.393503 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-c4d65651-e2cf-4afe-89b6-738e8cdb4abd tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 17641e09-70b6-4020-9fb5-31780056f2d9] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:44.403451 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c4d65651-e2cf-4afe-89b6-738e8cdb4abd tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:44.403647 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c4d65651-e2cf-4afe-89b6-738e8cdb4abd tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:44.407702 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c4d65651-e2cf-4afe-89b6-738e8cdb4abd tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:44.408156 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c4d65651-e2cf-4afe-89b6-738e8cdb4abd tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:44.609120 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-c4d65651-e2cf-4afe-89b6-738e8cdb4abd tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:44.618278 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-c4d65651-e2cf-4afe-89b6-738e8cdb4abd tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9" status: 200 len: 1366 microversion: 2.1 time: 0.229273 Jun 14 18:28:44.619458 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 95/197] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:44 2022] GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9 => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:44.914770 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-bb586ced-ae3d-447f-af42-04cfaa81a751 req-72d0937f-92d4-45da-b0a9-5bc79567e629 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17641e09-70b6-4020-9fb5-31780056f2d9", "tag": "fb8d49e9-2644-493b-ba67-f249b7b5c2b1"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:28:44.946044 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-bb586ced-ae3d-447f-af42-04cfaa81a751 req-72d0937f-92d4-45da-b0a9-5bc79567e629 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:44.947865 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-bb586ced-ae3d-447f-af42-04cfaa81a751 req-72d0937f-92d4-45da-b0a9-5bc79567e629 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:44.966594 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell1:SELECT=98 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:28:44.969059 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-bb586ced-ae3d-447f-af42-04cfaa81a751 req-72d0937f-92d4-45da-b0a9-5bc79567e629 service nova] Creating event network-changed:fb8d49e9-2644-493b-ba67-f249b7b5c2b1 for instance 17641e09-70b6-4020-9fb5-31780056f2d9 on hv-cinder-84456 Jun 14 18:28:44.975470 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-bb586ced-ae3d-447f-af42-04cfaa81a751 req-72d0937f-92d4-45da-b0a9-5bc79567e629 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071068 Jun 14 18:28:44.976106 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 103/198] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:28:45.342456 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-4af2c052-19af-4472-b959-f1630f75357a tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:28:45.343459 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-4af2c052-19af-4472-b959-f1630f75357a tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 99045096-d6ff-4e14-b710-1b1e2dd9a7c5] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:45.349534 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4af2c052-19af-4472-b959-f1630f75357a tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:45.350072 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4af2c052-19af-4472-b959-f1630f75357a tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:45.350862 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4af2c052-19af-4472-b959-f1630f75357a tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:45.351289 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4af2c052-19af-4472-b959-f1630f75357a tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:45.384732 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.objects.instance [None req-4af2c052-19af-4472-b959-f1630f75357a tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lazy-loading 'flavor' on Instance uuid 99045096-d6ff-4e14-b710-1b1e2dd9a7c5 {{(pid=118623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:28:45.398200 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell1:SELECT=100 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:28:45.638138 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-1c4f7cb8-da33-4b93-88fd-5cba8f19ed35 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:45.639219 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-1c4f7cb8-da33-4b93-88fd-5cba8f19ed35 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 17641e09-70b6-4020-9fb5-31780056f2d9] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:45.646014 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1c4f7cb8-da33-4b93-88fd-5cba8f19ed35 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:45.646376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1c4f7cb8-da33-4b93-88fd-5cba8f19ed35 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:45.647464 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1c4f7cb8-da33-4b93-88fd-5cba8f19ed35 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:45.647839 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1c4f7cb8-da33-4b93-88fd-5cba8f19ed35 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:45.689736 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-4af2c052-19af-4472-b959-f1630f75357a tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "POST /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5/action" status: 200 len: 32 microversion: 2.1 time: 0.350858 Jun 14 18:28:45.691111 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 96/199] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Jun 14 18:28:45 2022] POST /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5/action => generated 32 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 14 18:28:45.706115 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-c5be5be5-e2f9-4aa0-a3ab-4c3522e2ede9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:45.707635 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-c5be5be5-e2f9-4aa0-a3ab-4c3522e2ede9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 99045096-d6ff-4e14-b710-1b1e2dd9a7c5] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:45.720861 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c5be5be5-e2f9-4aa0-a3ab-4c3522e2ede9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:45.723687 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c5be5be5-e2f9-4aa0-a3ab-4c3522e2ede9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:45.724656 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c5be5be5-e2f9-4aa0-a3ab-4c3522e2ede9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:45.725163 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c5be5be5-e2f9-4aa0-a3ab-4c3522e2ede9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:45.892052 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-c5be5be5-e2f9-4aa0-a3ab-4c3522e2ede9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:45.900334 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-c5be5be5-e2f9-4aa0-a3ab-4c3522e2ede9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5" status: 200 len: 1520 microversion: 2.1 time: 0.198863 Jun 14 18:28:45.901213 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 97/200] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:45 2022] GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5 => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:46.325122 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-1c4f7cb8-da33-4b93-88fd-5cba8f19ed35 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:46.348789 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-1c4f7cb8-da33-4b93-88fd-5cba8f19ed35 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9" status: 200 len: 1366 microversion: 2.1 time: 0.716155 Jun 14 18:28:46.350168 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 104/201] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:45 2022] GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9 => generated 1366 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:28:46.919787 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-055ca54c-3c85-4859-9fd2-db19f321f3ff tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:46.920653 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-055ca54c-3c85-4859-9fd2-db19f321f3ff tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 99045096-d6ff-4e14-b710-1b1e2dd9a7c5] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:46.927831 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-055ca54c-3c85-4859-9fd2-db19f321f3ff tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:46.928448 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-055ca54c-3c85-4859-9fd2-db19f321f3ff tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:46.932003 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-055ca54c-3c85-4859-9fd2-db19f321f3ff tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:46.932003 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-055ca54c-3c85-4859-9fd2-db19f321f3ff tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:47.214134 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-055ca54c-3c85-4859-9fd2-db19f321f3ff tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:47.232669 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-055ca54c-3c85-4859-9fd2-db19f321f3ff tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5" status: 200 len: 1520 microversion: 2.1 time: 0.317971 Jun 14 18:28:47.246352 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 98/202] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:46 2022] GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5 => generated 1520 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:28:47.367406 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-84e5fb8e-e7a7-46ae-8565-ac48a4a87d90 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:47.368001 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-84e5fb8e-e7a7-46ae-8565-ac48a4a87d90 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 17641e09-70b6-4020-9fb5-31780056f2d9] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:47.385567 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-84e5fb8e-e7a7-46ae-8565-ac48a4a87d90 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:47.387056 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-84e5fb8e-e7a7-46ae-8565-ac48a4a87d90 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:47.388083 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-84e5fb8e-e7a7-46ae-8565-ac48a4a87d90 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:47.389904 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-84e5fb8e-e7a7-46ae-8565-ac48a4a87d90 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:47.568122 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-84e5fb8e-e7a7-46ae-8565-ac48a4a87d90 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:47.576931 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-84e5fb8e-e7a7-46ae-8565-ac48a4a87d90 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9" status: 200 len: 1366 microversion: 2.1 time: 0.213827 Jun 14 18:28:47.577525 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 105/203] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:47 2022] GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:48.255043 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-8457023e-82b9-4a26-8b63-557a41b14640 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:48.255635 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-8457023e-82b9-4a26-8b63-557a41b14640 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 99045096-d6ff-4e14-b710-1b1e2dd9a7c5] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:48.262470 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8457023e-82b9-4a26-8b63-557a41b14640 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:48.263015 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8457023e-82b9-4a26-8b63-557a41b14640 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:48.263879 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8457023e-82b9-4a26-8b63-557a41b14640 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:48.264369 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8457023e-82b9-4a26-8b63-557a41b14640 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:48.512487 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-8457023e-82b9-4a26-8b63-557a41b14640 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:48.534555 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-8457023e-82b9-4a26-8b63-557a41b14640 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5" status: 200 len: 1520 microversion: 2.1 time: 0.283541 Jun 14 18:28:48.535589 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 99/204] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:48 2022] GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5 => generated 1520 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:48.596387 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-ae85df3e-a330-4fb5-ae0c-15335797b2c8 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:48.597738 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-ae85df3e-a330-4fb5-ae0c-15335797b2c8 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 17641e09-70b6-4020-9fb5-31780056f2d9] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:48.600574 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell0:SELECT=2 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:28:48.601486 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell0:SELECT=10 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:28:48.610062 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ae85df3e-a330-4fb5-ae0c-15335797b2c8 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:48.611254 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ae85df3e-a330-4fb5-ae0c-15335797b2c8 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:48.611831 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ae85df3e-a330-4fb5-ae0c-15335797b2c8 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:48.612451 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ae85df3e-a330-4fb5-ae0c-15335797b2c8 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:48.888663 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-ae85df3e-a330-4fb5-ae0c-15335797b2c8 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:48.901717 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-ae85df3e-a330-4fb5-ae0c-15335797b2c8 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9" status: 200 len: 1366 microversion: 2.1 time: 0.310772 Jun 14 18:28:48.902350 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 106/205] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:48 2022] GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9 => generated 1366 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:49.556467 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-da93cc17-9351-4d08-8a09-dec6d8bf4bd2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:49.557194 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-da93cc17-9351-4d08-8a09-dec6d8bf4bd2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 99045096-d6ff-4e14-b710-1b1e2dd9a7c5] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:49.566993 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell0:SELECT=4 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:28:49.569089 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-da93cc17-9351-4d08-8a09-dec6d8bf4bd2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:49.569788 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-da93cc17-9351-4d08-8a09-dec6d8bf4bd2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:49.570726 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-da93cc17-9351-4d08-8a09-dec6d8bf4bd2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:49.572809 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-da93cc17-9351-4d08-8a09-dec6d8bf4bd2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:49.761593 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-da93cc17-9351-4d08-8a09-dec6d8bf4bd2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:49.769927 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-da93cc17-9351-4d08-8a09-dec6d8bf4bd2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5" status: 200 len: 1520 microversion: 2.1 time: 0.217325 Jun 14 18:28:49.770508 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 100/206] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:49 2022] GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5 => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:49.919906 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-34f8ff6f-0586-40c5-807a-f6450f4c2d26 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:49.921224 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-34f8ff6f-0586-40c5-807a-f6450f4c2d26 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 17641e09-70b6-4020-9fb5-31780056f2d9] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:49.935834 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-34f8ff6f-0586-40c5-807a-f6450f4c2d26 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:49.938165 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-34f8ff6f-0586-40c5-807a-f6450f4c2d26 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:49.945227 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-34f8ff6f-0586-40c5-807a-f6450f4c2d26 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:49.945227 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-34f8ff6f-0586-40c5-807a-f6450f4c2d26 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:50.383872 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-34f8ff6f-0586-40c5-807a-f6450f4c2d26 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:50.394199 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-34f8ff6f-0586-40c5-807a-f6450f4c2d26 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9" status: 200 len: 1366 microversion: 2.1 time: 0.477748 Jun 14 18:28:50.396038 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 107/207] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:49 2022] GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9 => generated 1366 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:50.788952 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-aa291b30-3d7c-4b59-adf4-988785e0a750 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:50.789791 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-aa291b30-3d7c-4b59-adf4-988785e0a750 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 99045096-d6ff-4e14-b710-1b1e2dd9a7c5] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:50.797887 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-aa291b30-3d7c-4b59-adf4-988785e0a750 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:50.798637 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-aa291b30-3d7c-4b59-adf4-988785e0a750 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:50.799660 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-aa291b30-3d7c-4b59-adf4-988785e0a750 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:50.800365 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-aa291b30-3d7c-4b59-adf4-988785e0a750 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:51.041501 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-aa291b30-3d7c-4b59-adf4-988785e0a750 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:51.059114 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-aa291b30-3d7c-4b59-adf4-988785e0a750 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5" status: 200 len: 1520 microversion: 2.1 time: 0.274678 Jun 14 18:28:51.063103 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 101/208] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:50 2022] GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5 => generated 1520 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:51.412810 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-ba3a8d18-3f25-44e1-acf8-007eaa7d0cc9 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:51.414054 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-ba3a8d18-3f25-44e1-acf8-007eaa7d0cc9 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 17641e09-70b6-4020-9fb5-31780056f2d9] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:51.425260 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ba3a8d18-3f25-44e1-acf8-007eaa7d0cc9 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:51.425260 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ba3a8d18-3f25-44e1-acf8-007eaa7d0cc9 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:51.430673 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ba3a8d18-3f25-44e1-acf8-007eaa7d0cc9 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:51.431391 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ba3a8d18-3f25-44e1-acf8-007eaa7d0cc9 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:51.874523 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-40066273-ed44-4ab5-85b5-7dfebdfd2e32 req-d5bb35c3-e553-43f0-8baa-39eb76e0df63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17641e09-70b6-4020-9fb5-31780056f2d9", "name": "network-vif-plugged", "status": "completed", "tag": "fb8d49e9-2644-493b-ba67-f249b7b5c2b1"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:28:51.891424 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-40066273-ed44-4ab5-85b5-7dfebdfd2e32 req-d5bb35c3-e553-43f0-8baa-39eb76e0df63 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:51.891424 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-40066273-ed44-4ab5-85b5-7dfebdfd2e32 req-d5bb35c3-e553-43f0-8baa-39eb76e0df63 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:51.918759 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-40066273-ed44-4ab5-85b5-7dfebdfd2e32 req-d5bb35c3-e553-43f0-8baa-39eb76e0df63 service nova] Creating event network-vif-plugged:fb8d49e9-2644-493b-ba67-f249b7b5c2b1 for instance 17641e09-70b6-4020-9fb5-31780056f2d9 on hv-cinder-84456 Jun 14 18:28:51.940494 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-40066273-ed44-4ab5-85b5-7dfebdfd2e32 req-d5bb35c3-e553-43f0-8baa-39eb76e0df63 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070114 Jun 14 18:28:51.942451 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 102/209] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:28:52.082601 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-5bc5d06d-2884-4350-a5de-7acd14c6d28e tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:52.083759 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-5bc5d06d-2884-4350-a5de-7acd14c6d28e tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 99045096-d6ff-4e14-b710-1b1e2dd9a7c5] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:52.096362 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5bc5d06d-2884-4350-a5de-7acd14c6d28e tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:52.096819 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5bc5d06d-2884-4350-a5de-7acd14c6d28e tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:52.097856 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5bc5d06d-2884-4350-a5de-7acd14c6d28e tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:52.098603 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5bc5d06d-2884-4350-a5de-7acd14c6d28e tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:52.155994 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-ba3a8d18-3f25-44e1-acf8-007eaa7d0cc9 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:52.167752 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-ba3a8d18-3f25-44e1-acf8-007eaa7d0cc9 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9" status: 200 len: 1366 microversion: 2.1 time: 0.759182 Jun 14 18:28:52.168733 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 108/210] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:51 2022] GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9 => generated 1366 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:28:52.370937 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-5bc5d06d-2884-4350-a5de-7acd14c6d28e tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:52.389160 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-5bc5d06d-2884-4350-a5de-7acd14c6d28e tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5" status: 200 len: 1520 microversion: 2.1 time: 0.309349 Jun 14 18:28:52.393557 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 103/211] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:52 2022] GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5 => generated 1520 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:28:53.189353 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-3986aa7e-e9f1-4214-ad0f-9f78cf0bb7b8 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:53.190476 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-3986aa7e-e9f1-4214-ad0f-9f78cf0bb7b8 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 17641e09-70b6-4020-9fb5-31780056f2d9] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:53.200158 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3986aa7e-e9f1-4214-ad0f-9f78cf0bb7b8 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:53.200781 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3986aa7e-e9f1-4214-ad0f-9f78cf0bb7b8 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:53.201893 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3986aa7e-e9f1-4214-ad0f-9f78cf0bb7b8 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:53.202424 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3986aa7e-e9f1-4214-ad0f-9f78cf0bb7b8 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:53.414594 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-d49f92e1-2533-4f35-83a9-01c8c1c4ac79 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:53.420614 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-d49f92e1-2533-4f35-83a9-01c8c1c4ac79 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 99045096-d6ff-4e14-b710-1b1e2dd9a7c5] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:53.425277 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d49f92e1-2533-4f35-83a9-01c8c1c4ac79 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:53.425967 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d49f92e1-2533-4f35-83a9-01c8c1c4ac79 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:53.426965 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d49f92e1-2533-4f35-83a9-01c8c1c4ac79 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:53.427620 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d49f92e1-2533-4f35-83a9-01c8c1c4ac79 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:53.443515 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-3986aa7e-e9f1-4214-ad0f-9f78cf0bb7b8 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:53.473481 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-3986aa7e-e9f1-4214-ad0f-9f78cf0bb7b8 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9" status: 200 len: 1366 microversion: 2.1 time: 0.286608 Jun 14 18:28:53.480314 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 109/212] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:53 2022] GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9 => generated 1366 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:53.653313 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-d49f92e1-2533-4f35-83a9-01c8c1c4ac79 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:53.676231 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-d49f92e1-2533-4f35-83a9-01c8c1c4ac79 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5" status: 200 len: 1520 microversion: 2.1 time: 0.267831 Jun 14 18:28:53.676978 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 104/213] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:53 2022] GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5 => generated 1520 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:54.497273 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-d59ff448-e250-44c8-b047-bc710144ff30 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:54.497751 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-d59ff448-e250-44c8-b047-bc710144ff30 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 17641e09-70b6-4020-9fb5-31780056f2d9] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:54.506586 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d59ff448-e250-44c8-b047-bc710144ff30 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:54.507337 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d59ff448-e250-44c8-b047-bc710144ff30 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:54.511584 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d59ff448-e250-44c8-b047-bc710144ff30 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:54.511584 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d59ff448-e250-44c8-b047-bc710144ff30 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:54.694234 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-efb2e0a1-1cc9-4b8d-98e1-022faabdd232 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:54.701139 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-efb2e0a1-1cc9-4b8d-98e1-022faabdd232 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 99045096-d6ff-4e14-b710-1b1e2dd9a7c5] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:54.703398 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-efb2e0a1-1cc9-4b8d-98e1-022faabdd232 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:54.704015 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-efb2e0a1-1cc9-4b8d-98e1-022faabdd232 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:54.705057 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-efb2e0a1-1cc9-4b8d-98e1-022faabdd232 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:54.705520 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-efb2e0a1-1cc9-4b8d-98e1-022faabdd232 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:54.751979 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-d59ff448-e250-44c8-b047-bc710144ff30 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:54.768507 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-d59ff448-e250-44c8-b047-bc710144ff30 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9" status: 200 len: 1366 microversion: 2.1 time: 0.276085 Jun 14 18:28:54.780367 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 110/214] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:54 2022] GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9 => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:54.880504 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-efb2e0a1-1cc9-4b8d-98e1-022faabdd232 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:54.889074 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-efb2e0a1-1cc9-4b8d-98e1-022faabdd232 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5" status: 200 len: 1520 microversion: 2.1 time: 0.198653 Jun 14 18:28:54.891013 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 105/215] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:54 2022] GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5 => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:28:55.787484 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-643c69a0-c91b-4517-a906-a86a7f5428c1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:55.788629 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-643c69a0-c91b-4517-a906-a86a7f5428c1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 17641e09-70b6-4020-9fb5-31780056f2d9] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:55.798777 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-643c69a0-c91b-4517-a906-a86a7f5428c1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:55.799460 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-643c69a0-c91b-4517-a906-a86a7f5428c1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:55.800524 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-643c69a0-c91b-4517-a906-a86a7f5428c1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:55.801113 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-643c69a0-c91b-4517-a906-a86a7f5428c1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:55.907622 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-6e0fcadf-3a78-45a5-a3ab-74e5bb35f22c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:55.908820 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-6e0fcadf-3a78-45a5-a3ab-74e5bb35f22c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 99045096-d6ff-4e14-b710-1b1e2dd9a7c5] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:55.915735 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6e0fcadf-3a78-45a5-a3ab-74e5bb35f22c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:55.916450 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6e0fcadf-3a78-45a5-a3ab-74e5bb35f22c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:55.918864 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6e0fcadf-3a78-45a5-a3ab-74e5bb35f22c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:55.922609 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6e0fcadf-3a78-45a5-a3ab-74e5bb35f22c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:56.053289 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-643c69a0-c91b-4517-a906-a86a7f5428c1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:56.066878 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-643c69a0-c91b-4517-a906-a86a7f5428c1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9" status: 200 len: 1555 microversion: 2.1 time: 0.283280 Jun 14 18:28:56.076733 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 111/216] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:55 2022] GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9 => generated 1555 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:56.086918 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-5bcf11ee-fbb5-423b-92cc-72dc7b8c186e tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:56.087411 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-5bcf11ee-fbb5-423b-92cc-72dc7b8c186e tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 17641e09-70b6-4020-9fb5-31780056f2d9] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:56.094367 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5bcf11ee-fbb5-423b-92cc-72dc7b8c186e tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:56.095721 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5bcf11ee-fbb5-423b-92cc-72dc7b8c186e tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:56.096842 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5bcf11ee-fbb5-423b-92cc-72dc7b8c186e tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:56.097533 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5bcf11ee-fbb5-423b-92cc-72dc7b8c186e tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:56.116491 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-6e0fcadf-3a78-45a5-a3ab-74e5bb35f22c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:56.125214 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-6e0fcadf-3a78-45a5-a3ab-74e5bb35f22c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5" status: 200 len: 1520 microversion: 2.1 time: 0.221517 Jun 14 18:28:56.125837 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 106/217] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:55 2022] GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5 => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:28:56.222272 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-5bcf11ee-fbb5-423b-92cc-72dc7b8c186e tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.139434 Jun 14 18:28:56.223125 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 112/218] 10.222.0.78 () {58 vars in 1274 bytes} [Tue Jun 14 18:28:56 2022] GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9/os-interface => generated 284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:28:56.941853 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-c6fd67b8-4452-44e4-bb7b-92b639e820bc tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:56.943094 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-c6fd67b8-4452-44e4-bb7b-92b639e820bc tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:56.951756 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c6fd67b8-4452-44e4-bb7b-92b639e820bc tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:56.952377 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c6fd67b8-4452-44e4-bb7b-92b639e820bc tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:56.953384 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c6fd67b8-4452-44e4-bb7b-92b639e820bc tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:56.954652 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c6fd67b8-4452-44e4-bb7b-92b639e820bc tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:56.988782 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-c6fd67b8-4452-44e4-bb7b-92b639e820bc tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2/ips" status: 200 len: 153 microversion: 2.20 time: 0.051313 Jun 14 18:28:56.989371 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 107/219] 10.222.0.78 () {60 vars in 1288 bytes} [Tue Jun 14 18:28:56 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2/ips => generated 153 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 18:28:57.143342 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-03aa6c01-3c5a-4052-ad7f-db3796f68ac9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:57.147811 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-03aa6c01-3c5a-4052-ad7f-db3796f68ac9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 99045096-d6ff-4e14-b710-1b1e2dd9a7c5] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:57.160240 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-03aa6c01-3c5a-4052-ad7f-db3796f68ac9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:57.160772 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-03aa6c01-3c5a-4052-ad7f-db3796f68ac9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:57.163452 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-03aa6c01-3c5a-4052-ad7f-db3796f68ac9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:57.163937 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-03aa6c01-3c5a-4052-ad7f-db3796f68ac9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:57.399128 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-03aa6c01-3c5a-4052-ad7f-db3796f68ac9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:57.426141 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-03aa6c01-3c5a-4052-ad7f-db3796f68ac9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5" status: 200 len: 1520 microversion: 2.1 time: 0.286298 Jun 14 18:28:57.428145 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 113/220] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:57 2022] GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5 => generated 1520 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:58.124334 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-2172c4d7-649c-410d-b60a-c71914ac9c6a req-74de4993-0547-44fe-9d42-e8996b315001 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17641e09-70b6-4020-9fb5-31780056f2d9", "tag": "fb8d49e9-2644-493b-ba67-f249b7b5c2b1"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:28:58.136948 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-2172c4d7-649c-410d-b60a-c71914ac9c6a req-74de4993-0547-44fe-9d42-e8996b315001 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:58.137471 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-2172c4d7-649c-410d-b60a-c71914ac9c6a req-74de4993-0547-44fe-9d42-e8996b315001 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:58.163324 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-2172c4d7-649c-410d-b60a-c71914ac9c6a req-74de4993-0547-44fe-9d42-e8996b315001 service nova] Creating event network-changed:fb8d49e9-2644-493b-ba67-f249b7b5c2b1 for instance 17641e09-70b6-4020-9fb5-31780056f2d9 on hv-cinder-84456 Jun 14 18:28:58.171048 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-2172c4d7-649c-410d-b60a-c71914ac9c6a req-74de4993-0547-44fe-9d42-e8996b315001 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053201 Jun 14 18:28:58.176204 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 108/221] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:28:58.445459 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-36d16d3c-5418-4c6d-ae92-620f6b15dddb tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:58.446089 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-36d16d3c-5418-4c6d-ae92-620f6b15dddb tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 99045096-d6ff-4e14-b710-1b1e2dd9a7c5] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:58.462184 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-36d16d3c-5418-4c6d-ae92-620f6b15dddb tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:58.464217 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-36d16d3c-5418-4c6d-ae92-620f6b15dddb tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:58.465907 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-36d16d3c-5418-4c6d-ae92-620f6b15dddb tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:58.466366 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-36d16d3c-5418-4c6d-ae92-620f6b15dddb tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:58.804559 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-36d16d3c-5418-4c6d-ae92-620f6b15dddb tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:28:58.818989 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-36d16d3c-5418-4c6d-ae92-620f6b15dddb tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5" status: 200 len: 1520 microversion: 2.1 time: 0.377877 Jun 14 18:28:58.823900 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 114/222] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:58 2022] GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5 => generated 1520 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:28:59.811386 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-85e7987d-4ca6-4c91-bb40-119146512347 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:28:59.812065 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-85e7987d-4ca6-4c91-bb40-119146512347 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:59.835849 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-85e7987d-4ca6-4c91-bb40-119146512347 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:59.836322 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-85e7987d-4ca6-4c91-bb40-119146512347 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:59.837124 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-85e7987d-4ca6-4c91-bb40-119146512347 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:59.837724 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-85e7987d-4ca6-4c91-bb40-119146512347 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:59.841752 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-c7a075d2-337f-4b54-aa83-2d10e57c1bec tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:28:59.842387 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-c7a075d2-337f-4b54-aa83-2d10e57c1bec tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 99045096-d6ff-4e14-b710-1b1e2dd9a7c5] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:28:59.868853 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c7a075d2-337f-4b54-aa83-2d10e57c1bec tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:59.869313 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c7a075d2-337f-4b54-aa83-2d10e57c1bec tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:59.870755 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c7a075d2-337f-4b54-aa83-2d10e57c1bec tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:28:59.871445 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c7a075d2-337f-4b54-aa83-2d10e57c1bec tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:28:59.907030 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.objects.instance [None req-85e7987d-4ca6-4c91-bb40-119146512347 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lazy-loading 'flavor' on Instance uuid 2876875b-5dbe-4032-949a-3357292296a2 {{(pid=118623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:29:00.733851 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-85e7987d-4ca6-4c91-bb40-119146512347 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "POST /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2/action" status: 202 len: 0 microversion: 2.20 time: 0.927492 Jun 14 18:29:00.734902 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 109/223] 10.222.0.78 () {62 vars in 1318 bytes} [Tue Jun 14 18:28:59 2022] POST /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2/action => generated 0 bytes in 930 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 14 18:29:00.746122 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-06b75aa1-174a-418f-b295-38794070bff3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:00.747157 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-06b75aa1-174a-418f-b295-38794070bff3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:00.755101 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-06b75aa1-174a-418f-b295-38794070bff3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:00.755564 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-06b75aa1-174a-418f-b295-38794070bff3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:00.756549 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-06b75aa1-174a-418f-b295-38794070bff3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:00.757042 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-06b75aa1-174a-418f-b295-38794070bff3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:00.777221 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-c7a075d2-337f-4b54-aa83-2d10e57c1bec tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:00.785160 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-c7a075d2-337f-4b54-aa83-2d10e57c1bec tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5" status: 200 len: 1520 microversion: 2.1 time: 0.949442 Jun 14 18:29:00.803311 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 115/224] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:28:59 2022] GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5 => generated 1520 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:29:01.032942 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-06b75aa1-174a-418f-b295-38794070bff3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:01.044344 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-06b75aa1-174a-418f-b295-38794070bff3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:01.046298 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-06b75aa1-174a-418f-b295-38794070bff3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:01.048403 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-06b75aa1-174a-418f-b295-38794070bff3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1724 microversion: 2.20 time: 0.309155 Jun 14 18:29:01.049510 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 110/225] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:29:00 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1724 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:29:01.805786 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-6c7a30a7-5066-4a38-842e-e78894d9950d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:01.806419 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-6c7a30a7-5066-4a38-842e-e78894d9950d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 99045096-d6ff-4e14-b710-1b1e2dd9a7c5] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:01.813498 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6c7a30a7-5066-4a38-842e-e78894d9950d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:01.815192 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6c7a30a7-5066-4a38-842e-e78894d9950d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:01.815192 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6c7a30a7-5066-4a38-842e-e78894d9950d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:01.815192 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6c7a30a7-5066-4a38-842e-e78894d9950d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:02.031167 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-6c7a30a7-5066-4a38-842e-e78894d9950d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:02.038981 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-6c7a30a7-5066-4a38-842e-e78894d9950d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5" status: 200 len: 1520 microversion: 2.1 time: 0.237109 Jun 14 18:29:02.040168 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 116/226] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:01 2022] GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5 => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:02.070532 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-ff596d02-5218-4e0d-adf5-5ce95467e922 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:02.072394 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-ff596d02-5218-4e0d-adf5-5ce95467e922 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:02.082510 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ff596d02-5218-4e0d-adf5-5ce95467e922 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:02.083253 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ff596d02-5218-4e0d-adf5-5ce95467e922 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:02.084199 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ff596d02-5218-4e0d-adf5-5ce95467e922 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:02.084785 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ff596d02-5218-4e0d-adf5-5ce95467e922 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:02.116605 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:29:02.333537 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-ff596d02-5218-4e0d-adf5-5ce95467e922 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:02.343506 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-ff596d02-5218-4e0d-adf5-5ce95467e922 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:02.345199 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-ff596d02-5218-4e0d-adf5-5ce95467e922 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:02.346449 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-ff596d02-5218-4e0d-adf5-5ce95467e922 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1724 microversion: 2.20 time: 0.283239 Jun 14 18:29:02.347169 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 111/227] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:29:02 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1724 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:29:02.820677 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-10ff94c4-29b3-4233-a1e0-1475c8e6ce42 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:02.821742 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-10ff94c4-29b3-4233-a1e0-1475c8e6ce42 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:02.835572 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-10ff94c4-29b3-4233-a1e0-1475c8e6ce42 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:02.836024 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-10ff94c4-29b3-4233-a1e0-1475c8e6ce42 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:02.836801 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-10ff94c4-29b3-4233-a1e0-1475c8e6ce42 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:02.837231 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-10ff94c4-29b3-4233-a1e0-1475c8e6ce42 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:02.898739 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-10ff94c4-29b3-4233-a1e0-1475c8e6ce42 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe/ips" status: 200 len: 145 microversion: 2.1 time: 0.075419 Jun 14 18:29:02.910538 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 117/228] 10.222.0.78 () {58 vars in 1247 bytes} [Tue Jun 14 18:29:02 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe/ips => generated 145 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:29:03.057610 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-14d2454e-2071-4eda-8976-2aa1559905dc tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:03.058466 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-14d2454e-2071-4eda-8976-2aa1559905dc tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 99045096-d6ff-4e14-b710-1b1e2dd9a7c5] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:03.062235 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_api:SELECT=58 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:29:03.065933 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-14d2454e-2071-4eda-8976-2aa1559905dc tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:03.066391 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-14d2454e-2071-4eda-8976-2aa1559905dc tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:03.067174 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-14d2454e-2071-4eda-8976-2aa1559905dc tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:03.078494 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-14d2454e-2071-4eda-8976-2aa1559905dc tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:03.369294 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-7d1f19bb-d813-4230-bd6e-e112f7d276df tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:03.372559 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-7d1f19bb-d813-4230-bd6e-e112f7d276df tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:03.383835 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:29:03.386244 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7d1f19bb-d813-4230-bd6e-e112f7d276df tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:03.386851 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7d1f19bb-d813-4230-bd6e-e112f7d276df tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:03.387786 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7d1f19bb-d813-4230-bd6e-e112f7d276df tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:03.388251 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7d1f19bb-d813-4230-bd6e-e112f7d276df tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:03.414570 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-14d2454e-2071-4eda-8976-2aa1559905dc tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:03.442753 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-14d2454e-2071-4eda-8976-2aa1559905dc tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5" status: 200 len: 1520 microversion: 2.1 time: 0.388556 Jun 14 18:29:03.458304 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 112/229] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:03 2022] GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5 => generated 1520 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:03.638991 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-7d1f19bb-d813-4230-bd6e-e112f7d276df tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:03.649920 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-7d1f19bb-d813-4230-bd6e-e112f7d276df tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:03.651813 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-7d1f19bb-d813-4230-bd6e-e112f7d276df tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:03.656433 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-7d1f19bb-d813-4230-bd6e-e112f7d276df tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1724 microversion: 2.20 time: 0.291348 Jun 14 18:29:03.657368 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 118/230] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:29:03 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1724 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:29:04.480127 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-26649dbb-9f9a-4e72-83ab-9f666ffb72b4 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:04.483883 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-26649dbb-9f9a-4e72-83ab-9f666ffb72b4 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 99045096-d6ff-4e14-b710-1b1e2dd9a7c5] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:04.518761 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-26649dbb-9f9a-4e72-83ab-9f666ffb72b4 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:04.527494 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-26649dbb-9f9a-4e72-83ab-9f666ffb72b4 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:04.529763 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-26649dbb-9f9a-4e72-83ab-9f666ffb72b4 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:04.537028 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-26649dbb-9f9a-4e72-83ab-9f666ffb72b4 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:04.709935 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-f6dbcc5e-8fb5-4ada-96cc-6da7d3ac48de tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:04.712735 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-f6dbcc5e-8fb5-4ada-96cc-6da7d3ac48de tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:04.748048 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f6dbcc5e-8fb5-4ada-96cc-6da7d3ac48de tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:04.750636 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f6dbcc5e-8fb5-4ada-96cc-6da7d3ac48de tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:04.756139 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f6dbcc5e-8fb5-4ada-96cc-6da7d3ac48de tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:04.757260 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f6dbcc5e-8fb5-4ada-96cc-6da7d3ac48de tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:05.000890 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-26649dbb-9f9a-4e72-83ab-9f666ffb72b4 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:05.035481 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-26649dbb-9f9a-4e72-83ab-9f666ffb72b4 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5" status: 200 len: 1520 microversion: 2.1 time: 0.563363 Jun 14 18:29:05.038174 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 113/231] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:04 2022] GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5 => generated 1520 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:05.115521 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-f6dbcc5e-8fb5-4ada-96cc-6da7d3ac48de tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:05.134527 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-f6dbcc5e-8fb5-4ada-96cc-6da7d3ac48de tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:05.136469 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-f6dbcc5e-8fb5-4ada-96cc-6da7d3ac48de tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:05.138273 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-f6dbcc5e-8fb5-4ada-96cc-6da7d3ac48de tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1724 microversion: 2.20 time: 0.455613 Jun 14 18:29:05.140888 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 119/232] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:29:04 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1724 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:29:06.003650 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-126bed59-144a-4d5e-98cf-00c47fc0359e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb06fd21-9bdf-4055-804f-1ffb6c070bbe"}} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:29:06.007410 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-126bed59-144a-4d5e-98cf-00c47fc0359e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:06.036975 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-126bed59-144a-4d5e-98cf-00c47fc0359e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:06.038130 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-126bed59-144a-4d5e-98cf-00c47fc0359e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:06.039083 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-126bed59-144a-4d5e-98cf-00c47fc0359e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:06.040271 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-126bed59-144a-4d5e-98cf-00c47fc0359e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:06.056706 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-fa0635f5-61d8-483a-b23c-7a7d98cd049c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:06.057548 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-fa0635f5-61d8-483a-b23c-7a7d98cd049c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 99045096-d6ff-4e14-b710-1b1e2dd9a7c5] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:06.079210 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-fa0635f5-61d8-483a-b23c-7a7d98cd049c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:06.079210 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-fa0635f5-61d8-483a-b23c-7a7d98cd049c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:06.079210 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-fa0635f5-61d8-483a-b23c-7a7d98cd049c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:06.079210 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-fa0635f5-61d8-483a-b23c-7a7d98cd049c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:06.446996 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-fa0635f5-61d8-483a-b23c-7a7d98cd049c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:06.474093 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-fa0635f5-61d8-483a-b23c-7a7d98cd049c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5" status: 200 len: 1520 microversion: 2.1 time: 0.420764 Jun 14 18:29:06.476949 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 120/233] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:06 2022] GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5 => generated 1520 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:29:06.486634 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-9f397f85-f49c-467d-9700-22e17467b3ee tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:06.491848 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-9f397f85-f49c-467d-9700-22e17467b3ee tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:06.498544 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9f397f85-f49c-467d-9700-22e17467b3ee tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:06.499016 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9f397f85-f49c-467d-9700-22e17467b3ee tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:06.499727 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9f397f85-f49c-467d-9700-22e17467b3ee tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:06.500157 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9f397f85-f49c-467d-9700-22e17467b3ee tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:06.531773 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell1:SELECT=100 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:29:06.737161 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-9f397f85-f49c-467d-9700-22e17467b3ee tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:06.746981 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-9f397f85-f49c-467d-9700-22e17467b3ee tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:06.748633 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-9f397f85-f49c-467d-9700-22e17467b3ee tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:06.750061 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-9f397f85-f49c-467d-9700-22e17467b3ee tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1724 microversion: 2.20 time: 0.270737 Jun 14 18:29:06.750668 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 121/234] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:29:06 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1724 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:29:07.443582 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-45bce13c-17d5-4d29-9f19-5dde2e3ceb85 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Action: 'create', calling method: .version_select at 0x7efe704da8b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1240575293", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnDgHmO2RmN7iVEyu+CUvdjau6NuEVCfeZdSF4Iom3EKiE3J6vsosOGs5q13lSLKn05TJfaXwr+uUPwXgCaZupUVtMlPdQsI6U0c9wpwLMwv9rLdbx+5wQiH2S2+PrkFQ=="}} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:29:07.513497 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.quota [None req-45bce13c-17d5-4d29-9f19-5dde2e3ceb85 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Getting quotas for project 437f86b97f3c4725955bc1f71017af5e. Resources: {'key_pairs'} {{(pid=118624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:29:07.519612 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.quota [None req-45bce13c-17d5-4d29-9f19-5dde2e3ceb85 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Getting quotas for user 48a00b33efb04f55b1d3c0a985536df2 and project 437f86b97f3c4725955bc1f71017af5e. Resources: {'key_pairs'} {{(pid=118624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:29:07.641017 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-45bce13c-17d5-4d29-9f19-5dde2e3ceb85 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.889065 Jun 14 18:29:07.642006 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 122/235] 10.222.0.78 () {60 vars in 1158 bytes} [Tue Jun 14 18:29:06 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:29:07.665223 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-d23f2904-dd90-4e69-a1d1-c3305c867a8e tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:07.666141 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-d23f2904-dd90-4e69-a1d1-c3305c867a8e tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 99045096-d6ff-4e14-b710-1b1e2dd9a7c5] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:07.676938 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d23f2904-dd90-4e69-a1d1-c3305c867a8e tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:07.678919 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d23f2904-dd90-4e69-a1d1-c3305c867a8e tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:07.680232 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d23f2904-dd90-4e69-a1d1-c3305c867a8e tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:07.680881 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d23f2904-dd90-4e69-a1d1-c3305c867a8e tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:07.751596 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-126bed59-144a-4d5e-98cf-00c47fc0359e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "POST /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.752944 Jun 14 18:29:07.752540 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 114/236] 10.222.0.78 () {60 vars in 1322 bytes} [Tue Jun 14 18:29:05 2022] POST /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe/os-volume_attachments => generated 194 bytes in 1755 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:29:07.793299 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-e6f91726-7c22-43d4-96df-9776e4bdeb92 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:07.795779 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-e6f91726-7c22-43d4-96df-9776e4bdeb92 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:07.826853 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e6f91726-7c22-43d4-96df-9776e4bdeb92 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:07.827587 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e6f91726-7c22-43d4-96df-9776e4bdeb92 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:07.829645 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e6f91726-7c22-43d4-96df-9776e4bdeb92 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:07.830106 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e6f91726-7c22-43d4-96df-9776e4bdeb92 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:07.939574 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-d23f2904-dd90-4e69-a1d1-c3305c867a8e tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:07.949601 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-d23f2904-dd90-4e69-a1d1-c3305c867a8e tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5" status: 200 len: 1500 microversion: 2.1 time: 0.306350 Jun 14 18:29:07.950716 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 123/237] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:07 2022] GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5 => generated 1500 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:07.981299 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-59252469-73a3-43ab-8b3e-7906e42b0f42 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "523ea9de-910c-4440-92db-e8f5ac1fc842"}} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:29:07.982838 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-59252469-73a3-43ab-8b3e-7906e42b0f42 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 99045096-d6ff-4e14-b710-1b1e2dd9a7c5] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:07.997392 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-59252469-73a3-43ab-8b3e-7906e42b0f42 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:08.001342 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-59252469-73a3-43ab-8b3e-7906e42b0f42 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:08.002356 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-59252469-73a3-43ab-8b3e-7906e42b0f42 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:08.002889 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-59252469-73a3-43ab-8b3e-7906e42b0f42 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:08.054241 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.wsgi [None req-59252469-73a3-43ab-8b3e-7906e42b0f42 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] HTTP exception thrown: Cannot 'attach_volume' instance 99045096-d6ff-4e14-b710-1b1e2dd9a7c5 while it is in vm_state rescued Jun 14 18:29:08.056192 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-59252469-73a3-43ab-8b3e-7906e42b0f42 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Request method failure captured: Jun 14 18:29:08.056192 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: request: POST /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5/os-volume_attachments HTTP/1.1 Jun 14 18:29:08.056192 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept: application/json Jun 14 18:29:08.056192 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept-Encoding: identity Jun 14 18:29:08.056192 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Connection: close Jun 14 18:29:08.056192 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Length: 74 Jun 14 18:29:08.056192 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Type: application/json Jun 14 18:29:08.056192 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Host: 10.222.0.78 Jun 14 18:29:08.056192 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Openstack-System-Scope: None Jun 14 18:29:08.056192 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: User-Agent: python-urllib3/1.26.9 Jun 14 18:29:08.056192 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Auth-Token: gAAAAABiqNMLmsc67uKqI-N-C_X_FhrUcqjTvgCN_KzDpDCXteEoTPgrRoD6Ywb_SWbZmcccxpWD5TO2tWjenTUuj22mzrGN0E1HFTTIaMbUD5cHq7A5utVjIauxMwF4xyAg3dOi-qAU6NI2QSJxQv20Gtu9ypjDarfFBE2B0JV-w4G2UG_jGvU Jun 14 18:29:08.056192 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Id: None Jun 14 18:29:08.056192 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Name: None Jun 14 18:29:08.056192 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Identity-Status: Confirmed Jun 14 18:29:08.056192 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Is-Admin-Project: True Jun 14 18:29:08.056192 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Id: default Jun 14 18:29:08.056192 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Name: Default Jun 14 18:29:08.056192 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Id: a5c99e2733b440cc99c9749761f4b4cd Jun 14 18:29:08.056192 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2012041525 Jun 14 18:29:08.056192 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Role: reader,member Jun 14 18:29:08.056192 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Roles: reader,member Jun 14 18:29:08.058361 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a5c99e2733b440cc99c9749761f4b4cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a5c99e2733b440cc99c9749761f4b4cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a5c99e2733b440cc99c9749761f4b4cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a5c99e2733b440cc99c9749761f4b4cd"}]}] Jun 14 18:29:08.058361 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2012041525 Jun 14 18:29:08.058361 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Id: a5c99e2733b440cc99c9749761f4b4cd Jun 14 18:29:08.058361 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2012041525 Jun 14 18:29:08.058361 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User: tempest-ServerRescueNegativeTestJSON-2012041525-project Jun 14 18:29:08.058361 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Id: default Jun 14 18:29:08.058361 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Name: Default Jun 14 18:29:08.058361 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Id: 7bf1c044cb3843b4a54edd75a3f04685 Jun 14 18:29:08.058361 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2012041525-project Jun 14 18:29:08.058361 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Jun 14 18:29:08.058361 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: {"volumeAttachment": {"volumeId": "523ea9de-910c-4440-92db-e8f5ac1fc842"}} Jun 14 18:29:08.058361 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: method: > Jun 14 18:29:08.059232 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: exception: Cannot 'attach_volume' instance 99045096-d6ff-4e14-b710-1b1e2dd9a7c5 while it is in vm_state rescued Jun 14 18:29:08.059232 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: action_args: {'server_id': '99045096-d6ff-4e14-b710-1b1e2dd9a7c5', 'body': {'volumeAttachment': {'volumeId': '523ea9de-910c-4440-92db-e8f5ac1fc842'}}} Jun 14 18:29:08.059232 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:29:08.059232 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:29:08.059232 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 14 18:29:08.059232 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 14 18:29:08.059232 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 14 18:29:08.059232 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 14 18:29:08.059232 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 14 18:29:08.059232 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 14 18:29:08.059232 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 99045096-d6ff-4e14-b710-1b1e2dd9a7c5 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 14 18:29:08.059232 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:29:08.059232 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:29:08.059232 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:29:08.059232 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:29:08.059232 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:29:08.059232 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:29:08.059232 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:29:08.059232 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:29:08.060600 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:29:08.060600 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:29:08.060600 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 14 18:29:08.060600 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 14 18:29:08.060600 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 14 18:29:08.060600 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 14 18:29:08.060600 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 14 18:29:08.060600 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 14 18:29:08.060600 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 14 18:29:08.060600 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 14 18:29:08.060600 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 14 18:29:08.060600 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 14 18:29:08.060600 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 99045096-d6ff-4e14-b710-1b1e2dd9a7c5 while it is in vm_state rescued Jun 14 18:29:08.060600 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:29:08.060600 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:29:08.060600 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:29:08.060600 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:29:08.060600 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:29:08.060600 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:29:08.062059 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:29:08.062059 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:29:08.062059 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 99045096-d6ff-4e14-b710-1b1e2dd9a7c5 while it is in vm_state rescued Jun 14 18:29:08.062059 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:29:08.063493 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-59252469-73a3-43ab-8b3e-7906e42b0f42 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Returning 409 to user: Cannot 'attach_volume' instance 99045096-d6ff-4e14-b710-1b1e2dd9a7c5 while it is in vm_state rescued {{(pid=118624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:29:08.064582 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-59252469-73a3-43ab-8b3e-7906e42b0f42 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "POST /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.088517 Jun 14 18:29:08.065380 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 124/238] 10.222.0.78 () {60 vars in 1322 bytes} [Tue Jun 14 18:29:07 2022] POST /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5/os-volume_attachments => generated 152 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 14 18:29:08.084843 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-c924e7f6-e051-4991-a144-6b669eefeef0 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:29:08.085368 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-c924e7f6-e051-4991-a144-6b669eefeef0 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 99045096-d6ff-4e14-b710-1b1e2dd9a7c5] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:08.101193 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c924e7f6-e051-4991-a144-6b669eefeef0 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:08.102598 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c924e7f6-e051-4991-a144-6b669eefeef0 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:08.113434 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c924e7f6-e051-4991-a144-6b669eefeef0 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:08.113434 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c924e7f6-e051-4991-a144-6b669eefeef0 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:08.280733 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-e6f91726-7c22-43d4-96df-9776e4bdeb92 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:08.293191 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-e6f91726-7c22-43d4-96df-9776e4bdeb92 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:08.299457 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-e6f91726-7c22-43d4-96df-9776e4bdeb92 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:08.300713 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-e6f91726-7c22-43d4-96df-9776e4bdeb92 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1724 microversion: 2.20 time: 0.533858 Jun 14 18:29:08.320389 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 115/239] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:29:07 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1724 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:29:08.476830 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-c924e7f6-e051-4991-a144-6b669eefeef0 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "POST /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5/action" status: 202 len: 0 microversion: 2.1 time: 0.402024 Jun 14 18:29:08.480026 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 125/240] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Jun 14 18:29:08 2022] POST /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5/action => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:29:08.497005 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-2556b109-e458-4ffd-a0ea-2bdb58593179 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:08.497566 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-2556b109-e458-4ffd-a0ea-2bdb58593179 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 99045096-d6ff-4e14-b710-1b1e2dd9a7c5] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:08.513675 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2556b109-e458-4ffd-a0ea-2bdb58593179 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:08.514116 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2556b109-e458-4ffd-a0ea-2bdb58593179 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:08.515333 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2556b109-e458-4ffd-a0ea-2bdb58593179 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:08.521510 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2556b109-e458-4ffd-a0ea-2bdb58593179 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:08.903824 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-2556b109-e458-4ffd-a0ea-2bdb58593179 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:08.921167 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-2556b109-e458-4ffd-a0ea-2bdb58593179 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5" status: 200 len: 1508 microversion: 2.1 time: 0.435041 Jun 14 18:29:08.922421 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 116/241] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:08 2022] GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5 => generated 1508 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:09.335270 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-81837f95-43b6-49c3-8534-412f54e15a98 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:09.340014 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-81837f95-43b6-49c3-8534-412f54e15a98 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:09.358043 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-81837f95-43b6-49c3-8534-412f54e15a98 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:09.358985 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-81837f95-43b6-49c3-8534-412f54e15a98 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:09.360193 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-81837f95-43b6-49c3-8534-412f54e15a98 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:09.360706 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-81837f95-43b6-49c3-8534-412f54e15a98 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:09.758702 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-81837f95-43b6-49c3-8534-412f54e15a98 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:09.772932 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-81837f95-43b6-49c3-8534-412f54e15a98 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:09.774737 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-81837f95-43b6-49c3-8534-412f54e15a98 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:09.776098 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-81837f95-43b6-49c3-8534-412f54e15a98 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1724 microversion: 2.20 time: 0.449982 Jun 14 18:29:09.789206 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 126/242] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:29:09 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1724 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:29:09.941052 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-66d8f513-9213-452d-a583-577951192e28 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:09.942769 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-66d8f513-9213-452d-a583-577951192e28 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 99045096-d6ff-4e14-b710-1b1e2dd9a7c5] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:09.953338 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-66d8f513-9213-452d-a583-577951192e28 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:09.954247 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-66d8f513-9213-452d-a583-577951192e28 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:09.955298 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-66d8f513-9213-452d-a583-577951192e28 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:09.956101 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-66d8f513-9213-452d-a583-577951192e28 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:10.266272 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-66d8f513-9213-452d-a583-577951192e28 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:10.275830 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-66d8f513-9213-452d-a583-577951192e28 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5" status: 200 len: 1508 microversion: 2.1 time: 0.339633 Jun 14 18:29:10.279631 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 117/243] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:09 2022] GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5 => generated 1508 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:10.796007 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-3d207ba0-a874-4054-9332-e29f1b9da468 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:10.796643 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-3d207ba0-a874-4054-9332-e29f1b9da468 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:10.827011 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3d207ba0-a874-4054-9332-e29f1b9da468 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:10.828122 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3d207ba0-a874-4054-9332-e29f1b9da468 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:10.830229 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3d207ba0-a874-4054-9332-e29f1b9da468 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:10.830997 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3d207ba0-a874-4054-9332-e29f1b9da468 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:11.123186 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-3d207ba0-a874-4054-9332-e29f1b9da468 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:11.133166 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-3d207ba0-a874-4054-9332-e29f1b9da468 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:11.134882 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-3d207ba0-a874-4054-9332-e29f1b9da468 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:11.137220 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-3d207ba0-a874-4054-9332-e29f1b9da468 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1724 microversion: 2.20 time: 0.346357 Jun 14 18:29:11.147925 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 127/244] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:29:10 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1724 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:29:11.295612 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-d58b456e-1da9-4077-92b2-33f2e9c60636 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:11.296888 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-d58b456e-1da9-4077-92b2-33f2e9c60636 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 99045096-d6ff-4e14-b710-1b1e2dd9a7c5] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:11.326484 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d58b456e-1da9-4077-92b2-33f2e9c60636 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:11.326879 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d58b456e-1da9-4077-92b2-33f2e9c60636 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:11.332749 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d58b456e-1da9-4077-92b2-33f2e9c60636 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:11.333260 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d58b456e-1da9-4077-92b2-33f2e9c60636 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:11.660561 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-d58b456e-1da9-4077-92b2-33f2e9c60636 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:11.675538 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-d58b456e-1da9-4077-92b2-33f2e9c60636 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5" status: 200 len: 1508 microversion: 2.1 time: 0.385280 Jun 14 18:29:11.676839 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 118/245] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:11 2022] GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5 => generated 1508 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:12.157247 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-905a3792-a1cc-44da-ac9b-efb4e8eff7b2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:12.158161 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-905a3792-a1cc-44da-ac9b-efb4e8eff7b2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:12.165047 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-905a3792-a1cc-44da-ac9b-efb4e8eff7b2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:12.168400 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-905a3792-a1cc-44da-ac9b-efb4e8eff7b2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:12.168400 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-905a3792-a1cc-44da-ac9b-efb4e8eff7b2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:12.168400 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-905a3792-a1cc-44da-ac9b-efb4e8eff7b2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:12.461949 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-905a3792-a1cc-44da-ac9b-efb4e8eff7b2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:12.485152 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-905a3792-a1cc-44da-ac9b-efb4e8eff7b2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:12.486753 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-905a3792-a1cc-44da-ac9b-efb4e8eff7b2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:12.487967 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-905a3792-a1cc-44da-ac9b-efb4e8eff7b2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1724 microversion: 2.20 time: 0.337020 Jun 14 18:29:12.505815 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 128/246] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:29:12 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1724 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:29:12.704868 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-8a592581-8319-47d7-88a3-1bf824840bcf tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:12.706313 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-8a592581-8319-47d7-88a3-1bf824840bcf tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 99045096-d6ff-4e14-b710-1b1e2dd9a7c5] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:12.714131 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8a592581-8319-47d7-88a3-1bf824840bcf tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:12.715386 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8a592581-8319-47d7-88a3-1bf824840bcf tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:12.716480 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8a592581-8319-47d7-88a3-1bf824840bcf tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:12.717243 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8a592581-8319-47d7-88a3-1bf824840bcf tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:13.068753 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-8a592581-8319-47d7-88a3-1bf824840bcf tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:13.079753 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-8a592581-8319-47d7-88a3-1bf824840bcf tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5" status: 200 len: 1514 microversion: 2.1 time: 0.378752 Jun 14 18:29:13.081508 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 119/247] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:12 2022] GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5 => generated 1514 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:13.516446 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-2e0a7e74-f81b-496f-95d9-06ba71237dd4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:13.518583 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-2e0a7e74-f81b-496f-95d9-06ba71237dd4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:13.538787 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2e0a7e74-f81b-496f-95d9-06ba71237dd4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:13.539604 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2e0a7e74-f81b-496f-95d9-06ba71237dd4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:13.565781 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2e0a7e74-f81b-496f-95d9-06ba71237dd4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:13.568290 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2e0a7e74-f81b-496f-95d9-06ba71237dd4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:14.300488 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-2e0a7e74-f81b-496f-95d9-06ba71237dd4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:14.320233 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-2e0a7e74-f81b-496f-95d9-06ba71237dd4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:14.322107 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-2e0a7e74-f81b-496f-95d9-06ba71237dd4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:14.324238 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-2e0a7e74-f81b-496f-95d9-06ba71237dd4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1724 microversion: 2.20 time: 0.813933 Jun 14 18:29:14.328358 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 129/248] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:29:13 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1724 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:29:15.345208 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-c6a87adb-e675-47c2-aefe-473fbf3a8cb4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:15.346153 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-c6a87adb-e675-47c2-aefe-473fbf3a8cb4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:15.352739 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c6a87adb-e675-47c2-aefe-473fbf3a8cb4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:15.354873 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c6a87adb-e675-47c2-aefe-473fbf3a8cb4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:15.355985 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c6a87adb-e675-47c2-aefe-473fbf3a8cb4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:15.356608 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c6a87adb-e675-47c2-aefe-473fbf3a8cb4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:15.806478 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-c6a87adb-e675-47c2-aefe-473fbf3a8cb4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:15.821356 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-c6a87adb-e675-47c2-aefe-473fbf3a8cb4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:15.824683 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-c6a87adb-e675-47c2-aefe-473fbf3a8cb4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:15.826265 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-c6a87adb-e675-47c2-aefe-473fbf3a8cb4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1724 microversion: 2.20 time: 0.485243 Jun 14 18:29:15.827024 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 120/249] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:29:15 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1724 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:29:16.073975 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-ce741cf2-107f-434a-a5ee-cbd5e2fe753e tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Action: 'create', calling method: .version_select at 0x7efe70644790>, body: {"keypair": {"name": "tempest-keypair-843213200", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8Nq9Jus2jwbWKEmRCiiBUfStbdQnvgPuIEH8c9100qKCkbr8MNZCTAcx0XMgOpZUVRLJhL/NN7R3s2e7TKkY2TQIzFW3DFVihpt9TbXnExLsOtCCPPKDf/kHAQAmpjZQ=="}} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:29:16.155872 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.quota [None req-ce741cf2-107f-434a-a5ee-cbd5e2fe753e tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Getting quotas for project a5c99e2733b440cc99c9749761f4b4cd. Resources: {'key_pairs'} {{(pid=118624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:29:16.167420 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.quota [None req-ce741cf2-107f-434a-a5ee-cbd5e2fe753e tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Getting quotas for user 7bf1c044cb3843b4a54edd75a3f04685 and project a5c99e2733b440cc99c9749761f4b4cd. Resources: {'key_pairs'} {{(pid=118624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:29:16.342265 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-ce741cf2-107f-434a-a5ee-cbd5e2fe753e tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.281038 Jun 14 18:29:16.350144 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 130/250] 10.222.0.78 () {60 vars in 1158 bytes} [Tue Jun 14 18:29:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:29:16.409925 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-7eec701a-2071-4e32-85aa-2c602bc8dfb4 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:29:16.443475 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7eec701a-2071-4e32-85aa-2c602bc8dfb4 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:16.444536 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7eec701a-2071-4e32-85aa-2c602bc8dfb4 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:16.538132 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-7eec701a-2071-4e32-85aa-2c602bc8dfb4 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Going to try to stop instance {{(pid=118623) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 14 18:29:16.770794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-7eec701a-2071-4e32-85aa-2c602bc8dfb4 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "POST /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe/action" status: 202 len: 0 microversion: 2.1 time: 0.370975 Jun 14 18:29:16.772132 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 121/251] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Jun 14 18:29:16 2022] POST /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe/action => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:29:16.780921 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-d5103ca0-0868-4bce-8699-f3e2f6c6f553 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:16.781952 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-d5103ca0-0868-4bce-8699-f3e2f6c6f553 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:16.814790 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d5103ca0-0868-4bce-8699-f3e2f6c6f553 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:16.815556 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d5103ca0-0868-4bce-8699-f3e2f6c6f553 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:16.816474 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d5103ca0-0868-4bce-8699-f3e2f6c6f553 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:16.842133 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d5103ca0-0868-4bce-8699-f3e2f6c6f553 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:16.857892 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-c3320f29-c192-49b5-8ca9-a796563fc934 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:16.858906 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-c3320f29-c192-49b5-8ca9-a796563fc934 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:16.881881 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c3320f29-c192-49b5-8ca9-a796563fc934 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:16.887511 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c3320f29-c192-49b5-8ca9-a796563fc934 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:16.887511 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c3320f29-c192-49b5-8ca9-a796563fc934 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:16.887511 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c3320f29-c192-49b5-8ca9-a796563fc934 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:17.253524 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-c3320f29-c192-49b5-8ca9-a796563fc934 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:17.268267 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-c3320f29-c192-49b5-8ca9-a796563fc934 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:17.270408 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-c3320f29-c192-49b5-8ca9-a796563fc934 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:17.274599 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-c3320f29-c192-49b5-8ca9-a796563fc934 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1724 microversion: 2.20 time: 0.426001 Jun 14 18:29:17.276807 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 122/252] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:29:16 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1724 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:29:17.299911 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-d5103ca0-0868-4bce-8699-f3e2f6c6f553 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:17.308930 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-d5103ca0-0868-4bce-8699-f3e2f6c6f553 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1724 microversion: 2.1 time: 0.532297 Jun 14 18:29:17.333852 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 131/253] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:16 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1724 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:18.306056 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-03e8a1cb-7070-4221-b668-1242a7cdc618 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:18.306945 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-03e8a1cb-7070-4221-b668-1242a7cdc618 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:18.328518 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-90e3f02b-bd9a-4d17-bffc-b25c49eb60dc tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:18.335590 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-90e3f02b-bd9a-4d17-bffc-b25c49eb60dc tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:18.335881 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-03e8a1cb-7070-4221-b668-1242a7cdc618 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:18.335881 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-03e8a1cb-7070-4221-b668-1242a7cdc618 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:18.337585 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-03e8a1cb-7070-4221-b668-1242a7cdc618 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:18.338059 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-03e8a1cb-7070-4221-b668-1242a7cdc618 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:18.350751 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-90e3f02b-bd9a-4d17-bffc-b25c49eb60dc tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:18.351077 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-90e3f02b-bd9a-4d17-bffc-b25c49eb60dc tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:18.351845 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-90e3f02b-bd9a-4d17-bffc-b25c49eb60dc tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:18.353736 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-90e3f02b-bd9a-4d17-bffc-b25c49eb60dc tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:18.713876 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-90e3f02b-bd9a-4d17-bffc-b25c49eb60dc tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:18.725507 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-90e3f02b-bd9a-4d17-bffc-b25c49eb60dc tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1724 microversion: 2.1 time: 0.400449 Jun 14 18:29:18.735162 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 132/254] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:18 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1724 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:29:18.850919 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-03e8a1cb-7070-4221-b668-1242a7cdc618 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:18.870614 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-03e8a1cb-7070-4221-b668-1242a7cdc618 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:18.873924 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-03e8a1cb-7070-4221-b668-1242a7cdc618 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:18.879456 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-03e8a1cb-7070-4221-b668-1242a7cdc618 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1745 microversion: 2.20 time: 0.577223 Jun 14 18:29:18.902808 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 123/255] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:29:18 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1745 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:29:19.692387 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-e61fe359-7d37-4e40-ac97-92ea45c7f8e9 req-a6f97d69-4977-4346-afe8-f6e242be4f54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2876875b-5dbe-4032-949a-3357292296a2", "name": "network-vif-plugged", "status": "completed", "tag": "ee384335-560e-4f82-a137-0b23b61ff825"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:29:19.712459 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-e61fe359-7d37-4e40-ac97-92ea45c7f8e9 req-a6f97d69-4977-4346-afe8-f6e242be4f54 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:19.713026 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-e61fe359-7d37-4e40-ac97-92ea45c7f8e9 req-a6f97d69-4977-4346-afe8-f6e242be4f54 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:19.745728 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-e61fe359-7d37-4e40-ac97-92ea45c7f8e9 req-a6f97d69-4977-4346-afe8-f6e242be4f54 service nova] Creating event network-vif-plugged:ee384335-560e-4f82-a137-0b23b61ff825 for instance 2876875b-5dbe-4032-949a-3357292296a2 on hv-cinder-84456 Jun 14 18:29:19.754000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-e61fe359-7d37-4e40-ac97-92ea45c7f8e9 req-a6f97d69-4977-4346-afe8-f6e242be4f54 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064241 Jun 14 18:29:19.754622 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-317edcb1-97bc-44e5-9645-d068a382949f tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:19.755545 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-317edcb1-97bc-44e5-9645-d068a382949f tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:19.755957 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 133/256] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:29:19.770386 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-317edcb1-97bc-44e5-9645-d068a382949f tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:19.770946 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-317edcb1-97bc-44e5-9645-d068a382949f tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:19.771747 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-317edcb1-97bc-44e5-9645-d068a382949f tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:19.772177 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-317edcb1-97bc-44e5-9645-d068a382949f tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:19.910025 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-9bb9209b-6396-43c9-bfdf-0906e35bd94e tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:19.910857 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-9bb9209b-6396-43c9-bfdf-0906e35bd94e tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:19.921709 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9bb9209b-6396-43c9-bfdf-0906e35bd94e tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:19.921709 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9bb9209b-6396-43c9-bfdf-0906e35bd94e tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:19.921709 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9bb9209b-6396-43c9-bfdf-0906e35bd94e tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:19.921709 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9bb9209b-6396-43c9-bfdf-0906e35bd94e tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:19.976798 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-317edcb1-97bc-44e5-9645-d068a382949f tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:20.002746 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-317edcb1-97bc-44e5-9645-d068a382949f tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1724 microversion: 2.1 time: 0.260686 Jun 14 18:29:20.022899 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 124/257] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:19 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1724 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:20.167882 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-9bb9209b-6396-43c9-bfdf-0906e35bd94e tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:20.176793 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-9bb9209b-6396-43c9-bfdf-0906e35bd94e tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:20.178777 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-9bb9209b-6396-43c9-bfdf-0906e35bd94e tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:20.180908 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-9bb9209b-6396-43c9-bfdf-0906e35bd94e tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1745 microversion: 2.20 time: 0.274960 Jun 14 18:29:20.181363 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 134/258] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:29:19 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1745 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:29:20.740292 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-afffc8f9-4a94-4cd9-a935-132e79e05c4d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-286435540", "imageRef": "e2555120-8576-4128-944f-40805aa95a9b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "64ebe0b0-052f-4256-be3c-102cc7ed63f3"}], "security_groups": [{"name": "tempest-securitygroup--722867485"}], "key_name": "tempest-keypair-843213200", "user_data": "}} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:29:21.042120 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-76c5b6f4-eaae-413c-bbac-019db145b414 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:21.042947 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-76c5b6f4-eaae-413c-bbac-019db145b414 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:21.052111 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-76c5b6f4-eaae-413c-bbac-019db145b414 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:21.052985 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-76c5b6f4-eaae-413c-bbac-019db145b414 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:21.054769 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-76c5b6f4-eaae-413c-bbac-019db145b414 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:21.055385 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-76c5b6f4-eaae-413c-bbac-019db145b414 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:21.269341 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-76c5b6f4-eaae-413c-bbac-019db145b414 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:21.278053 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-76c5b6f4-eaae-413c-bbac-019db145b414 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1724 microversion: 2.1 time: 0.241015 Jun 14 18:29:21.278598 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 135/259] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:21 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:29:21.283742 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-3def044f-fc3c-46c7-92fe-8686b3c51326 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:21.284348 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-3def044f-fc3c-46c7-92fe-8686b3c51326 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:21.294238 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3def044f-fc3c-46c7-92fe-8686b3c51326 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:21.295195 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3def044f-fc3c-46c7-92fe-8686b3c51326 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:21.296130 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3def044f-fc3c-46c7-92fe-8686b3c51326 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:21.296813 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3def044f-fc3c-46c7-92fe-8686b3c51326 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:21.502147 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-3def044f-fc3c-46c7-92fe-8686b3c51326 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:21.516589 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-3def044f-fc3c-46c7-92fe-8686b3c51326 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:21.518319 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-3def044f-fc3c-46c7-92fe-8686b3c51326 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:21.519857 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-3def044f-fc3c-46c7-92fe-8686b3c51326 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1740 microversion: 2.20 time: 0.239778 Jun 14 18:29:21.524334 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 136/260] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:29:21 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1740 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:29:22.316024 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-204800c8-0137-4441-ba95-82dac0c60eb8 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:22.317101 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-204800c8-0137-4441-ba95-82dac0c60eb8 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:22.324530 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-204800c8-0137-4441-ba95-82dac0c60eb8 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:22.325302 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-204800c8-0137-4441-ba95-82dac0c60eb8 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:22.326355 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-204800c8-0137-4441-ba95-82dac0c60eb8 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:22.326947 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-204800c8-0137-4441-ba95-82dac0c60eb8 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:22.565963 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-204800c8-0137-4441-ba95-82dac0c60eb8 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:22.599215 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-204800c8-0137-4441-ba95-82dac0c60eb8 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1724 microversion: 2.1 time: 0.287570 Jun 14 18:29:22.600187 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 137/261] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:22 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1724 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:22.611654 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-7fc761db-401d-471d-9056-b2d57dab12f2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:22.613733 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-7fc761db-401d-471d-9056-b2d57dab12f2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:22.627225 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7fc761db-401d-471d-9056-b2d57dab12f2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:22.631420 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7fc761db-401d-471d-9056-b2d57dab12f2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:22.631420 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7fc761db-401d-471d-9056-b2d57dab12f2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:22.631420 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7fc761db-401d-471d-9056-b2d57dab12f2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:23.045320 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-7fc761db-401d-471d-9056-b2d57dab12f2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:23.054392 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-7fc761db-401d-471d-9056-b2d57dab12f2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:23.056045 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-7fc761db-401d-471d-9056-b2d57dab12f2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:23.057292 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-7fc761db-401d-471d-9056-b2d57dab12f2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1740 microversion: 2.20 time: 0.455731 Jun 14 18:29:23.057899 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 138/262] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:29:22 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1740 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:29:23.631883 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-eef7d4c5-e162-44f8-902f-6e8e246712d5 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:23.635389 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-eef7d4c5-e162-44f8-902f-6e8e246712d5 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:23.665121 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-eef7d4c5-e162-44f8-902f-6e8e246712d5 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:23.666939 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-eef7d4c5-e162-44f8-902f-6e8e246712d5 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:23.668531 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-eef7d4c5-e162-44f8-902f-6e8e246712d5 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:23.669636 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-eef7d4c5-e162-44f8-902f-6e8e246712d5 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:24.139640 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-eef7d4c5-e162-44f8-902f-6e8e246712d5 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:24.142367 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:29:24.155272 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-eef7d4c5-e162-44f8-902f-6e8e246712d5 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1724 microversion: 2.1 time: 0.530766 Jun 14 18:29:24.156284 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 139/263] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:23 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1724 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:29:24.167466 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-d5f1ba15-1dff-40bf-91b5-e1ce7a6dd56c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:24.175062 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-d5f1ba15-1dff-40bf-91b5-e1ce7a6dd56c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:24.187799 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d5f1ba15-1dff-40bf-91b5-e1ce7a6dd56c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:24.208585 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d5f1ba15-1dff-40bf-91b5-e1ce7a6dd56c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:24.218221 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d5f1ba15-1dff-40bf-91b5-e1ce7a6dd56c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:24.218712 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d5f1ba15-1dff-40bf-91b5-e1ce7a6dd56c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:24.636184 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-d5f1ba15-1dff-40bf-91b5-e1ce7a6dd56c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:24.649894 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-d5f1ba15-1dff-40bf-91b5-e1ce7a6dd56c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:24.652511 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-d5f1ba15-1dff-40bf-91b5-e1ce7a6dd56c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:24.654261 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-d5f1ba15-1dff-40bf-91b5-e1ce7a6dd56c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1740 microversion: 2.20 time: 0.495964 Jun 14 18:29:24.655863 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 140/264] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:29:24 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1740 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:29:25.180021 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-c58c57e5-c1af-4f06-a3e4-a7c0e7c0910d tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:25.180437 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-c58c57e5-c1af-4f06-a3e4-a7c0e7c0910d tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:25.188921 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c58c57e5-c1af-4f06-a3e4-a7c0e7c0910d tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:25.189783 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c58c57e5-c1af-4f06-a3e4-a7c0e7c0910d tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:25.190639 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c58c57e5-c1af-4f06-a3e4-a7c0e7c0910d tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:25.191085 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c58c57e5-c1af-4f06-a3e4-a7c0e7c0910d tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:25.579489 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-c58c57e5-c1af-4f06-a3e4-a7c0e7c0910d tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:25.579489 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-c58c57e5-c1af-4f06-a3e4-a7c0e7c0910d tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1724 microversion: 2.1 time: 0.386885 Jun 14 18:29:25.579489 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 141/265] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:25 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1724 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:25.673439 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-b0d82c16-71c4-4f0c-9bc8-52487530a45d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:25.674259 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-b0d82c16-71c4-4f0c-9bc8-52487530a45d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:25.682906 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b0d82c16-71c4-4f0c-9bc8-52487530a45d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:25.683825 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b0d82c16-71c4-4f0c-9bc8-52487530a45d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:25.685068 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b0d82c16-71c4-4f0c-9bc8-52487530a45d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:25.685530 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b0d82c16-71c4-4f0c-9bc8-52487530a45d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:25.904984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-b0d82c16-71c4-4f0c-9bc8-52487530a45d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:25.914632 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-b0d82c16-71c4-4f0c-9bc8-52487530a45d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:25.917363 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-b0d82c16-71c4-4f0c-9bc8-52487530a45d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:25.919475 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-b0d82c16-71c4-4f0c-9bc8-52487530a45d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1740 microversion: 2.20 time: 0.250232 Jun 14 18:29:25.920943 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 142/266] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:29:25 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1740 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:29:26.585537 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-82f060db-de47-4186-b99b-2109f5165824 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:26.586264 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-82f060db-de47-4186-b99b-2109f5165824 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:26.592066 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell0:SELECT=8 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:29:26.606825 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-82f060db-de47-4186-b99b-2109f5165824 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:26.607890 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-82f060db-de47-4186-b99b-2109f5165824 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:26.609520 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-82f060db-de47-4186-b99b-2109f5165824 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:26.611033 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-82f060db-de47-4186-b99b-2109f5165824 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:26.800367 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-82f060db-de47-4186-b99b-2109f5165824 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:26.824631 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-82f060db-de47-4186-b99b-2109f5165824 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1724 microversion: 2.1 time: 0.239608 Jun 14 18:29:26.828147 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 143/267] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:26 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:26.956858 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-082acea5-a2af-410c-8d3a-340f4f83aba4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:26.956858 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-082acea5-a2af-410c-8d3a-340f4f83aba4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:26.969787 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-082acea5-a2af-410c-8d3a-340f4f83aba4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:26.970443 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-082acea5-a2af-410c-8d3a-340f4f83aba4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:26.972147 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-082acea5-a2af-410c-8d3a-340f4f83aba4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:26.972602 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-082acea5-a2af-410c-8d3a-340f4f83aba4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:27.285811 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-082acea5-a2af-410c-8d3a-340f4f83aba4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:27.303937 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-082acea5-a2af-410c-8d3a-340f4f83aba4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:27.311247 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-082acea5-a2af-410c-8d3a-340f4f83aba4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:27.313765 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-082acea5-a2af-410c-8d3a-340f4f83aba4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1740 microversion: 2.20 time: 0.363590 Jun 14 18:29:27.315437 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 144/268] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:29:26 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1740 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:29:27.850401 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-9e026a17-b20d-4d40-b9eb-33078baee582 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:27.851967 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-9e026a17-b20d-4d40-b9eb-33078baee582 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:27.859893 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9e026a17-b20d-4d40-b9eb-33078baee582 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:27.860181 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9e026a17-b20d-4d40-b9eb-33078baee582 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:27.861164 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9e026a17-b20d-4d40-b9eb-33078baee582 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:27.861860 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9e026a17-b20d-4d40-b9eb-33078baee582 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:28.142179 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-9e026a17-b20d-4d40-b9eb-33078baee582 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:28.153648 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-9e026a17-b20d-4d40-b9eb-33078baee582 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1724 microversion: 2.1 time: 0.308293 Jun 14 18:29:28.162515 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 145/269] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:27 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1724 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:28.336966 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-172eece0-305b-4a72-9e2f-ca32c66546ac tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:28.338886 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-172eece0-305b-4a72-9e2f-ca32c66546ac tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:28.349989 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-172eece0-305b-4a72-9e2f-ca32c66546ac tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:28.350889 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-172eece0-305b-4a72-9e2f-ca32c66546ac tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:28.352498 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-172eece0-305b-4a72-9e2f-ca32c66546ac tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:28.353482 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-172eece0-305b-4a72-9e2f-ca32c66546ac tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:28.694592 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-172eece0-305b-4a72-9e2f-ca32c66546ac tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:28.706039 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-172eece0-305b-4a72-9e2f-ca32c66546ac tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:28.707898 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-172eece0-305b-4a72-9e2f-ca32c66546ac tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:28.709204 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-172eece0-305b-4a72-9e2f-ca32c66546ac tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1740 microversion: 2.20 time: 0.378167 Jun 14 18:29:28.714033 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 146/270] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:29:28 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1740 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:29:29.179391 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-bd9e44ac-868c-441d-af0e-046c6d7ba4e6 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:29.182706 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-bd9e44ac-868c-441d-af0e-046c6d7ba4e6 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:29.195196 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-bd9e44ac-868c-441d-af0e-046c6d7ba4e6 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:29.196439 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-bd9e44ac-868c-441d-af0e-046c6d7ba4e6 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:29.200107 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-bd9e44ac-868c-441d-af0e-046c6d7ba4e6 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:29.201409 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-bd9e44ac-868c-441d-af0e-046c6d7ba4e6 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:29.614091 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-bd9e44ac-868c-441d-af0e-046c6d7ba4e6 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:29.629087 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-bd9e44ac-868c-441d-af0e-046c6d7ba4e6 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1724 microversion: 2.1 time: 0.456801 Jun 14 18:29:29.630425 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 147/271] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:29 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1724 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:29.733400 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-b110d328-dc27-4ce8-985f-0940649035e8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:29.734120 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-b110d328-dc27-4ce8-985f-0940649035e8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:29.759878 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b110d328-dc27-4ce8-985f-0940649035e8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:29.772830 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b110d328-dc27-4ce8-985f-0940649035e8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:29.774100 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b110d328-dc27-4ce8-985f-0940649035e8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:29.774567 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b110d328-dc27-4ce8-985f-0940649035e8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:29.977661 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-b110d328-dc27-4ce8-985f-0940649035e8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:29.989648 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:29:29.990527 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-b110d328-dc27-4ce8-985f-0940649035e8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:29.990527 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-b110d328-dc27-4ce8-985f-0940649035e8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:29.990527 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-b110d328-dc27-4ce8-985f-0940649035e8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1740 microversion: 2.20 time: 0.261180 Jun 14 18:29:29.994009 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 148/272] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:29:29 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1740 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:29:30.663138 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-08bb78ae-6282-4afb-ab86-28d40a62973b tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:30.663883 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-08bb78ae-6282-4afb-ab86-28d40a62973b tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:30.670986 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-08bb78ae-6282-4afb-ab86-28d40a62973b tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:30.673019 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-08bb78ae-6282-4afb-ab86-28d40a62973b tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:30.673019 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-08bb78ae-6282-4afb-ab86-28d40a62973b tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:30.673019 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-08bb78ae-6282-4afb-ab86-28d40a62973b tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:30.753683 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_api:SELECT=27 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:29:30.843048 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-08bb78ae-6282-4afb-ab86-28d40a62973b tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:30.852238 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-08bb78ae-6282-4afb-ab86-28d40a62973b tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1724 microversion: 2.1 time: 0.206655 Jun 14 18:29:30.852935 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 149/273] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:30 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:31.007935 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-e50c9922-d117-44dd-b570-b09e13a8d322 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:31.008749 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-e50c9922-d117-44dd-b570-b09e13a8d322 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:31.022285 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e50c9922-d117-44dd-b570-b09e13a8d322 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:31.024269 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e50c9922-d117-44dd-b570-b09e13a8d322 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:31.026077 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e50c9922-d117-44dd-b570-b09e13a8d322 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:31.026534 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e50c9922-d117-44dd-b570-b09e13a8d322 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:31.232329 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-e50c9922-d117-44dd-b570-b09e13a8d322 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:31.247675 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-e50c9922-d117-44dd-b570-b09e13a8d322 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:31.250152 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-e50c9922-d117-44dd-b570-b09e13a8d322 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:31.252164 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-e50c9922-d117-44dd-b570-b09e13a8d322 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1740 microversion: 2.20 time: 0.248428 Jun 14 18:29:31.266690 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 150/274] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:29:31 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1740 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:29:31.659195 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.network.neutron [None req-afffc8f9-4a94-4cd9-a935-132e79e05c4d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] validate_networks() for [('64ebe0b0-052f-4256-be3c-102cc7ed63f3', None, None, None, None, None)] {{(pid=118623) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 18:29:31.883139 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-f78c232e-9e4c-4601-a69d-ac0bfa8c2da9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:31.884373 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-f78c232e-9e4c-4601-a69d-ac0bfa8c2da9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:31.905478 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f78c232e-9e4c-4601-a69d-ac0bfa8c2da9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:31.906338 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f78c232e-9e4c-4601-a69d-ac0bfa8c2da9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:31.907408 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f78c232e-9e4c-4601-a69d-ac0bfa8c2da9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:31.911171 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f78c232e-9e4c-4601-a69d-ac0bfa8c2da9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:32.175769 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-f78c232e-9e4c-4601-a69d-ac0bfa8c2da9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:32.186581 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-f78c232e-9e4c-4601-a69d-ac0bfa8c2da9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1724 microversion: 2.1 time: 0.307329 Jun 14 18:29:32.196670 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 151/275] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:31 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1724 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:29:32.282103 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-8353e0b4-7153-431a-9548-6533af415a57 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:32.282732 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-8353e0b4-7153-431a-9548-6533af415a57 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:32.322953 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8353e0b4-7153-431a-9548-6533af415a57 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:32.323601 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8353e0b4-7153-431a-9548-6533af415a57 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:32.333095 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8353e0b4-7153-431a-9548-6533af415a57 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:32.333095 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8353e0b4-7153-431a-9548-6533af415a57 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:32.547249 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-afffc8f9-4a94-4cd9-a935-132e79e05c4d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Flavor limits 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 18:29:32.547687 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-afffc8f9-4a94-4cd9-a935-132e79e05c4d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Image limits 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 18:29:32.548167 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-afffc8f9-4a94-4cd9-a935-132e79e05c4d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Flavor pref 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 18:29:32.548577 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-afffc8f9-4a94-4cd9-a935-132e79e05c4d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Image pref 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 18:29:32.549226 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-afffc8f9-4a94-4cd9-a935-132e79e05c4d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 18:29:32.581277 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-afffc8f9-4a94-4cd9-a935-132e79e05c4d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:32.581794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-afffc8f9-4a94-4cd9-a935-132e79e05c4d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:32.585152 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-afffc8f9-4a94-4cd9-a935-132e79e05c4d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:32.585892 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-afffc8f9-4a94-4cd9-a935-132e79e05c4d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:32.679155 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-8353e0b4-7153-431a-9548-6533af415a57 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:32.691987 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-8353e0b4-7153-431a-9548-6533af415a57 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:32.693959 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-8353e0b4-7153-431a-9548-6533af415a57 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:32.695828 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-8353e0b4-7153-431a-9548-6533af415a57 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1740 microversion: 2.20 time: 0.421288 Jun 14 18:29:32.696617 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 152/276] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:29:32 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1740 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:29:32.720799 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.quota [None req-afffc8f9-4a94-4cd9-a935-132e79e05c4d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Getting quotas for project a5c99e2733b440cc99c9749761f4b4cd. Resources: {'instances', 'cores', 'ram'} {{(pid=118623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:29:32.736978 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.quota [None req-afffc8f9-4a94-4cd9-a935-132e79e05c4d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Getting quotas for user 7bf1c044cb3843b4a54edd75a3f04685 and project a5c99e2733b440cc99c9749761f4b4cd. Resources: {'instances', 'cores', 'ram'} {{(pid=118623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:29:32.810110 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-afffc8f9-4a94-4cd9-a935-132e79e05c4d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Going to run 1 instances... {{(pid=118623) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 18:29:32.812462 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-afffc8f9-4a94-4cd9-a935-132e79e05c4d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e2555120-8576-4128-944f-40805aa95a9b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118623) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 18:29:33.095003 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-afffc8f9-4a94-4cd9-a935-132e79e05c4d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 12.360641 Jun 14 18:29:33.096569 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 125/277] 10.222.0.78 () {60 vars in 1146 bytes} [Tue Jun 14 18:29:20 2022] POST /compute/v2.1/servers => generated 408 bytes in 12364 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 18:29:33.120402 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-ac58b754-6f4b-4e3c-af63-4d9d830585db tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:33.122084 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-ac58b754-6f4b-4e3c-af63-4d9d830585db tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:33.205734 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-34fb6f90-c256-4cab-b183-4e8ddd535fb8 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:33.206380 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-34fb6f90-c256-4cab-b183-4e8ddd535fb8 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:33.220240 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-34fb6f90-c256-4cab-b183-4e8ddd535fb8 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:33.220695 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-34fb6f90-c256-4cab-b183-4e8ddd535fb8 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:33.223388 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-34fb6f90-c256-4cab-b183-4e8ddd535fb8 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:33.223850 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-34fb6f90-c256-4cab-b183-4e8ddd535fb8 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:33.293165 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-ac58b754-6f4b-4e3c-af63-4d9d830585db tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:33.303189 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-ac58b754-6f4b-4e3c-af63-4d9d830585db tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1244 microversion: 2.1 time: 0.199267 Jun 14 18:29:33.303189 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 153/278] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:33 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1244 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:33.501374 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-34fb6f90-c256-4cab-b183-4e8ddd535fb8 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:33.514693 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-34fb6f90-c256-4cab-b183-4e8ddd535fb8 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1701 microversion: 2.1 time: 0.313515 Jun 14 18:29:33.532724 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-3be5b6e8-9917-45b2-acc3-d2601f7cb23f tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:29:33.534088 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 126/279] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:33 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1701 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:33.540367 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3be5b6e8-9917-45b2-acc3-d2601f7cb23f tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:33.541962 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3be5b6e8-9917-45b2-acc3-d2601f7cb23f tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:33.612132 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-3be5b6e8-9917-45b2-acc3-d2601f7cb23f tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Going to try to start instance {{(pid=118624) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 14 18:29:33.720183 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-f86228d6-2f60-40af-809a-6c7ef63be45d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:33.722803 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-f86228d6-2f60-40af-809a-6c7ef63be45d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:33.743384 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f86228d6-2f60-40af-809a-6c7ef63be45d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:33.746502 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f86228d6-2f60-40af-809a-6c7ef63be45d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:33.747532 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f86228d6-2f60-40af-809a-6c7ef63be45d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:33.748137 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f86228d6-2f60-40af-809a-6c7ef63be45d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:33.818383 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-3be5b6e8-9917-45b2-acc3-d2601f7cb23f tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "POST /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe/action" status: 202 len: 0 microversion: 2.1 time: 0.289577 Jun 14 18:29:33.824213 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 154/280] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Jun 14 18:29:33 2022] POST /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:29:33.838318 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-930d2cb3-6936-4716-8124-d413b3d46300 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:33.839861 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-930d2cb3-6936-4716-8124-d413b3d46300 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:33.885682 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-930d2cb3-6936-4716-8124-d413b3d46300 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:33.887533 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-930d2cb3-6936-4716-8124-d413b3d46300 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:33.889987 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-930d2cb3-6936-4716-8124-d413b3d46300 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:33.894286 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-930d2cb3-6936-4716-8124-d413b3d46300 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:34.151037 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-f86228d6-2f60-40af-809a-6c7ef63be45d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:34.176932 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-f86228d6-2f60-40af-809a-6c7ef63be45d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:34.180461 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-f86228d6-2f60-40af-809a-6c7ef63be45d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:34.184239 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-f86228d6-2f60-40af-809a-6c7ef63be45d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1740 microversion: 2.20 time: 0.468802 Jun 14 18:29:34.186042 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 127/281] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:29:33 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1740 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:29:34.262280 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-930d2cb3-6936-4716-8124-d413b3d46300 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:34.277709 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-930d2cb3-6936-4716-8124-d413b3d46300 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1710 microversion: 2.1 time: 0.451587 Jun 14 18:29:34.279655 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 155/282] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:33 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1710 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:34.324468 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-cea0b38c-b747-4251-afe4-253ab0935ead tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:34.325188 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-cea0b38c-b747-4251-afe4-253ab0935ead tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:34.452165 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-cea0b38c-b747-4251-afe4-253ab0935ead tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:34.468186 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-cea0b38c-b747-4251-afe4-253ab0935ead tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1244 microversion: 2.1 time: 0.149360 Jun 14 18:29:34.491809 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 128/283] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:34 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1244 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:35.204061 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-7689ef4f-2577-4a5d-8b5f-0261b2a4bf3f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:35.204840 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-7689ef4f-2577-4a5d-8b5f-0261b2a4bf3f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:35.225110 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7689ef4f-2577-4a5d-8b5f-0261b2a4bf3f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:35.229439 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7689ef4f-2577-4a5d-8b5f-0261b2a4bf3f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:35.232150 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7689ef4f-2577-4a5d-8b5f-0261b2a4bf3f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:35.233032 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7689ef4f-2577-4a5d-8b5f-0261b2a4bf3f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:35.297982 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-2fdf74ee-2441-4b0e-8576-a35a0680f47d tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:35.298706 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-2fdf74ee-2441-4b0e-8576-a35a0680f47d tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:35.318718 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2fdf74ee-2441-4b0e-8576-a35a0680f47d tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:35.321052 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2fdf74ee-2441-4b0e-8576-a35a0680f47d tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:35.324666 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2fdf74ee-2441-4b0e-8576-a35a0680f47d tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:35.330886 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2fdf74ee-2441-4b0e-8576-a35a0680f47d tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:35.340755 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:29:35.669437 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-2fdf74ee-2441-4b0e-8576-a35a0680f47d tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:35.679788 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-2fdf74ee-2441-4b0e-8576-a35a0680f47d tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1710 microversion: 2.1 time: 0.386332 Jun 14 18:29:35.680383 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 129/284] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:35 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1710 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:35.696633 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-7abf7ed9-e2f1-417f-b661-e3e344510f01 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:35.699477 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-7abf7ed9-e2f1-417f-b661-e3e344510f01 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:35.725462 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7abf7ed9-e2f1-417f-b661-e3e344510f01 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:35.730381 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7abf7ed9-e2f1-417f-b661-e3e344510f01 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:35.731677 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7abf7ed9-e2f1-417f-b661-e3e344510f01 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:35.732149 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7abf7ed9-e2f1-417f-b661-e3e344510f01 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:35.924394 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-7abf7ed9-e2f1-417f-b661-e3e344510f01 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:35.968533 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-7abf7ed9-e2f1-417f-b661-e3e344510f01 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1240 microversion: 2.1 time: 0.287042 Jun 14 18:29:35.974617 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 130/285] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:35 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1240 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:36.258537 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-7689ef4f-2577-4a5d-8b5f-0261b2a4bf3f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:36.268007 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-7689ef4f-2577-4a5d-8b5f-0261b2a4bf3f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:36.269667 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-7689ef4f-2577-4a5d-8b5f-0261b2a4bf3f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:36.280059 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-7689ef4f-2577-4a5d-8b5f-0261b2a4bf3f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1740 microversion: 2.20 time: 1.079956 Jun 14 18:29:36.295696 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 156/286] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:29:35 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1740 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:29:36.700280 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-31ac36d1-2c70-47dd-8fe7-5a6344e10cce tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:36.703137 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-31ac36d1-2c70-47dd-8fe7-5a6344e10cce tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:36.718868 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-31ac36d1-2c70-47dd-8fe7-5a6344e10cce tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:36.721838 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-31ac36d1-2c70-47dd-8fe7-5a6344e10cce tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:36.722955 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-31ac36d1-2c70-47dd-8fe7-5a6344e10cce tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:36.724678 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-31ac36d1-2c70-47dd-8fe7-5a6344e10cce tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:36.982935 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-31ac36d1-2c70-47dd-8fe7-5a6344e10cce tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:36.993490 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-31ac36d1-2c70-47dd-8fe7-5a6344e10cce tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1710 microversion: 2.1 time: 0.298907 Jun 14 18:29:36.998147 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 131/287] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:36 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1710 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:37.006123 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-f9b0609b-dd5b-4792-bd2e-56d4df15a884 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:37.006804 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-f9b0609b-dd5b-4792-bd2e-56d4df15a884 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:37.008578 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:29:37.021153 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f9b0609b-dd5b-4792-bd2e-56d4df15a884 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:37.024891 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f9b0609b-dd5b-4792-bd2e-56d4df15a884 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:37.024891 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f9b0609b-dd5b-4792-bd2e-56d4df15a884 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:37.024891 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f9b0609b-dd5b-4792-bd2e-56d4df15a884 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:37.168096 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-f9b0609b-dd5b-4792-bd2e-56d4df15a884 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:37.188216 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-f9b0609b-dd5b-4792-bd2e-56d4df15a884 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1304 microversion: 2.1 time: 0.185965 Jun 14 18:29:37.189119 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 157/288] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:37 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1304 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:37.303663 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-6059ef67-7791-4795-bc3c-702b23538734 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:37.305589 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-6059ef67-7791-4795-bc3c-702b23538734 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:37.319209 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6059ef67-7791-4795-bc3c-702b23538734 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:37.321876 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6059ef67-7791-4795-bc3c-702b23538734 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:37.325132 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6059ef67-7791-4795-bc3c-702b23538734 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:37.326401 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6059ef67-7791-4795-bc3c-702b23538734 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:37.551496 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-6059ef67-7791-4795-bc3c-702b23538734 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:37.564652 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-6059ef67-7791-4795-bc3c-702b23538734 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:37.566976 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-6059ef67-7791-4795-bc3c-702b23538734 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:37.568472 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-6059ef67-7791-4795-bc3c-702b23538734 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1740 microversion: 2.20 time: 0.269323 Jun 14 18:29:37.582286 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 132/289] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:29:37 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1740 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:29:38.013858 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-b4ab9415-0c27-4461-80c0-5760e00ec004 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:38.015110 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-b4ab9415-0c27-4461-80c0-5760e00ec004 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:38.022080 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b4ab9415-0c27-4461-80c0-5760e00ec004 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:38.026145 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b4ab9415-0c27-4461-80c0-5760e00ec004 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:38.026971 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b4ab9415-0c27-4461-80c0-5760e00ec004 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:38.027400 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b4ab9415-0c27-4461-80c0-5760e00ec004 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:38.237620 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-24e4bfec-bb10-4186-a305-c2fcddbbad84 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:38.239084 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-24e4bfec-bb10-4186-a305-c2fcddbbad84 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:38.275501 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-24e4bfec-bb10-4186-a305-c2fcddbbad84 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:38.276774 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-24e4bfec-bb10-4186-a305-c2fcddbbad84 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:38.280593 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-24e4bfec-bb10-4186-a305-c2fcddbbad84 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:38.282841 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-b4ab9415-0c27-4461-80c0-5760e00ec004 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:38.283922 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-24e4bfec-bb10-4186-a305-c2fcddbbad84 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:38.328361 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-b4ab9415-0c27-4461-80c0-5760e00ec004 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1710 microversion: 2.1 time: 0.318793 Jun 14 18:29:38.336274 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 158/290] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:38 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1710 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:38.558185 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-24e4bfec-bb10-4186-a305-c2fcddbbad84 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:38.567708 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-24e4bfec-bb10-4186-a305-c2fcddbbad84 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1302 microversion: 2.1 time: 0.363503 Jun 14 18:29:38.574246 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 133/291] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:38 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1302 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:38.593216 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-c44c67e3-9067-4570-9014-e445e9019b15 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:38.594378 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-c44c67e3-9067-4570-9014-e445e9019b15 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:38.640111 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c44c67e3-9067-4570-9014-e445e9019b15 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:38.645352 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c44c67e3-9067-4570-9014-e445e9019b15 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:38.651454 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c44c67e3-9067-4570-9014-e445e9019b15 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:38.655658 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c44c67e3-9067-4570-9014-e445e9019b15 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:39.186413 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-c44c67e3-9067-4570-9014-e445e9019b15 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:39.229558 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-c44c67e3-9067-4570-9014-e445e9019b15 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:39.229558 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-c44c67e3-9067-4570-9014-e445e9019b15 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:39.231862 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-c44c67e3-9067-4570-9014-e445e9019b15 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1740 microversion: 2.20 time: 0.646065 Jun 14 18:29:39.237984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 159/292] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:29:38 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1740 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:29:39.365719 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-3b882d1a-6a37-40ad-a24b-d3d30f659cb8 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:39.366680 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-3b882d1a-6a37-40ad-a24b-d3d30f659cb8 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:39.381263 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3b882d1a-6a37-40ad-a24b-d3d30f659cb8 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:39.381774 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3b882d1a-6a37-40ad-a24b-d3d30f659cb8 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:39.382589 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3b882d1a-6a37-40ad-a24b-d3d30f659cb8 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:39.383041 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3b882d1a-6a37-40ad-a24b-d3d30f659cb8 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:39.609959 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-f72771e0-d7dd-4a66-85a8-c23208649ae9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:39.609959 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-f72771e0-d7dd-4a66-85a8-c23208649ae9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:39.609959 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f72771e0-d7dd-4a66-85a8-c23208649ae9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:39.609959 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f72771e0-d7dd-4a66-85a8-c23208649ae9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:39.610302 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f72771e0-d7dd-4a66-85a8-c23208649ae9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:39.610302 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f72771e0-d7dd-4a66-85a8-c23208649ae9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:39.662557 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-3b882d1a-6a37-40ad-a24b-d3d30f659cb8 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:39.675249 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-3b882d1a-6a37-40ad-a24b-d3d30f659cb8 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1714 microversion: 2.1 time: 0.313912 Jun 14 18:29:39.687480 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 134/293] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:39 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1714 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:39.965046 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-f72771e0-d7dd-4a66-85a8-c23208649ae9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:39.973136 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-f72771e0-d7dd-4a66-85a8-c23208649ae9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1369 microversion: 2.1 time: 0.383920 Jun 14 18:29:39.988344 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 160/294] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:39 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1369 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:40.265678 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-6d439aab-705b-4b25-9371-cfbcf50dd1b6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:40.275065 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-6d439aab-705b-4b25-9371-cfbcf50dd1b6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:40.330307 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6d439aab-705b-4b25-9371-cfbcf50dd1b6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:40.331287 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6d439aab-705b-4b25-9371-cfbcf50dd1b6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:40.335025 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6d439aab-705b-4b25-9371-cfbcf50dd1b6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:40.340288 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6d439aab-705b-4b25-9371-cfbcf50dd1b6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:40.679572 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-6d439aab-705b-4b25-9371-cfbcf50dd1b6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:40.690500 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-6d439aab-705b-4b25-9371-cfbcf50dd1b6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:40.692208 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-6d439aab-705b-4b25-9371-cfbcf50dd1b6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:40.693718 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-6d439aab-705b-4b25-9371-cfbcf50dd1b6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1740 microversion: 2.20 time: 0.438622 Jun 14 18:29:40.710444 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 135/295] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:29:40 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1740 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:29:40.790457 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-51836b38-59cf-41b3-9a69-a732e1085b76 req-cc711f4c-9a36-4055-8c94-11e4228447d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e66ffa48-038e-40ba-b075-bafc9eb4b015", "tag": "6e99f823-8a81-4709-b6d7-f5393c08507e"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:29:40.830768 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-51836b38-59cf-41b3-9a69-a732e1085b76 req-cc711f4c-9a36-4055-8c94-11e4228447d2 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:40.831894 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-51836b38-59cf-41b3-9a69-a732e1085b76 req-cc711f4c-9a36-4055-8c94-11e4228447d2 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:40.858150 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-51836b38-59cf-41b3-9a69-a732e1085b76 req-cc711f4c-9a36-4055-8c94-11e4228447d2 service nova] Creating event network-changed:6e99f823-8a81-4709-b6d7-f5393c08507e for instance e66ffa48-038e-40ba-b075-bafc9eb4b015 on hv-cinder-84456 Jun 14 18:29:40.886052 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-51836b38-59cf-41b3-9a69-a732e1085b76 req-cc711f4c-9a36-4055-8c94-11e4228447d2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101831 Jun 14 18:29:40.889274 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 161/296] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:29:40.990310 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-a2a5ce99-7b99-48cb-871d-bec7e774b8af tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:40.990929 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-a2a5ce99-7b99-48cb-871d-bec7e774b8af tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:41.007518 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a2a5ce99-7b99-48cb-871d-bec7e774b8af tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:41.008170 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a2a5ce99-7b99-48cb-871d-bec7e774b8af tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:41.009023 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a2a5ce99-7b99-48cb-871d-bec7e774b8af tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:41.016203 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a2a5ce99-7b99-48cb-871d-bec7e774b8af tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:41.284917 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-a2a5ce99-7b99-48cb-871d-bec7e774b8af tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:41.295905 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-a2a5ce99-7b99-48cb-871d-bec7e774b8af tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1369 microversion: 2.1 time: 0.309396 Jun 14 18:29:41.305611 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 136/297] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:40 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1369 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:29:41.713719 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-2c4e2ef0-0598-4ef6-8824-019309ba56d2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:41.714710 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-2c4e2ef0-0598-4ef6-8824-019309ba56d2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:41.747957 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2c4e2ef0-0598-4ef6-8824-019309ba56d2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:41.751704 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2c4e2ef0-0598-4ef6-8824-019309ba56d2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:41.751704 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2c4e2ef0-0598-4ef6-8824-019309ba56d2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:41.751704 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2c4e2ef0-0598-4ef6-8824-019309ba56d2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:42.173010 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-2c4e2ef0-0598-4ef6-8824-019309ba56d2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:42.187302 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-2c4e2ef0-0598-4ef6-8824-019309ba56d2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:42.194060 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-2c4e2ef0-0598-4ef6-8824-019309ba56d2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:42.196396 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-2c4e2ef0-0598-4ef6-8824-019309ba56d2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1740 microversion: 2.20 time: 0.487571 Jun 14 18:29:42.199416 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 162/298] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:29:41 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1740 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:29:42.361155 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-35abc4d6-f5f3-4597-a5b3-6268097484b7 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:42.363920 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-35abc4d6-f5f3-4597-a5b3-6268097484b7 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:42.418826 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-35abc4d6-f5f3-4597-a5b3-6268097484b7 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:42.422676 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-35abc4d6-f5f3-4597-a5b3-6268097484b7 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:42.423323 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-35abc4d6-f5f3-4597-a5b3-6268097484b7 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:42.424061 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-35abc4d6-f5f3-4597-a5b3-6268097484b7 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:42.446532 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-7887bab7-5d70-4592-9c2f-18d9a001952c tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:42.447211 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-7887bab7-5d70-4592-9c2f-18d9a001952c tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 17641e09-70b6-4020-9fb5-31780056f2d9] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:42.465508 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7887bab7-5d70-4592-9c2f-18d9a001952c tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:42.466484 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7887bab7-5d70-4592-9c2f-18d9a001952c tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:42.469287 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7887bab7-5d70-4592-9c2f-18d9a001952c tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:42.470119 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7887bab7-5d70-4592-9c2f-18d9a001952c tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:42.521267 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-7887bab7-5d70-4592-9c2f-18d9a001952c tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9/ips" status: 200 len: 149 microversion: 2.1 time: 0.078878 Jun 14 18:29:42.523593 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 163/299] 10.222.0.78 () {58 vars in 1247 bytes} [Tue Jun 14 18:29:42 2022] GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9/ips => generated 149 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:29:42.656620 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell0:SELECT=2 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:29:42.694169 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-35abc4d6-f5f3-4597-a5b3-6268097484b7 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:42.705641 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-35abc4d6-f5f3-4597-a5b3-6268097484b7 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1369 microversion: 2.1 time: 0.391888 Jun 14 18:29:42.706949 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 137/300] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:42 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1369 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:43.221848 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-06e64908-a59a-49e4-a7fc-c6b88bf76fc4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:43.224233 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-06e64908-a59a-49e4-a7fc-c6b88bf76fc4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:43.246561 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-06e64908-a59a-49e4-a7fc-c6b88bf76fc4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:43.247333 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-06e64908-a59a-49e4-a7fc-c6b88bf76fc4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:43.248702 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-06e64908-a59a-49e4-a7fc-c6b88bf76fc4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:43.249484 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-06e64908-a59a-49e4-a7fc-c6b88bf76fc4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:43.315148 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell0:SELECT=2 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:29:43.506241 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-06e64908-a59a-49e4-a7fc-c6b88bf76fc4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:43.528405 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-06e64908-a59a-49e4-a7fc-c6b88bf76fc4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:43.531322 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-06e64908-a59a-49e4-a7fc-c6b88bf76fc4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:43.533231 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-06e64908-a59a-49e4-a7fc-c6b88bf76fc4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1740 microversion: 2.20 time: 0.320294 Jun 14 18:29:43.535237 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 164/301] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:29:43 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1740 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:29:43.731707 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-42fd4576-37bf-45dd-9e81-570b3fe3e437 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:43.736299 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-42fd4576-37bf-45dd-9e81-570b3fe3e437 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:43.758426 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-42fd4576-37bf-45dd-9e81-570b3fe3e437 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:43.758426 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-42fd4576-37bf-45dd-9e81-570b3fe3e437 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:43.760158 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-42fd4576-37bf-45dd-9e81-570b3fe3e437 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:43.760668 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-42fd4576-37bf-45dd-9e81-570b3fe3e437 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:44.124279 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-42fd4576-37bf-45dd-9e81-570b3fe3e437 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:44.137072 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-42fd4576-37bf-45dd-9e81-570b3fe3e437 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1369 microversion: 2.1 time: 0.411667 Jun 14 18:29:44.138251 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 138/302] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:43 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1369 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:44.556387 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-87df880e-be33-407b-aeb6-dac0d0b22054 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:44.557936 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-87df880e-be33-407b-aeb6-dac0d0b22054 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:44.572148 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-87df880e-be33-407b-aeb6-dac0d0b22054 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:44.573226 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-87df880e-be33-407b-aeb6-dac0d0b22054 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:44.575046 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-87df880e-be33-407b-aeb6-dac0d0b22054 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:44.575547 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-87df880e-be33-407b-aeb6-dac0d0b22054 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:44.754425 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-87df880e-be33-407b-aeb6-dac0d0b22054 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:44.764144 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-87df880e-be33-407b-aeb6-dac0d0b22054 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:44.765813 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-87df880e-be33-407b-aeb6-dac0d0b22054 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:44.767348 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-87df880e-be33-407b-aeb6-dac0d0b22054 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1740 microversion: 2.20 time: 0.215068 Jun 14 18:29:44.768124 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 165/303] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:29:44 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1740 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:29:45.158698 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-8a9f3c99-893a-4f1b-b27e-2cb7200110fa tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:45.160451 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-8a9f3c99-893a-4f1b-b27e-2cb7200110fa tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:45.166746 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell0:SELECT=8 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:29:45.208287 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8a9f3c99-893a-4f1b-b27e-2cb7200110fa tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:45.213384 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8a9f3c99-893a-4f1b-b27e-2cb7200110fa tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:45.217494 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8a9f3c99-893a-4f1b-b27e-2cb7200110fa tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:45.223608 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8a9f3c99-893a-4f1b-b27e-2cb7200110fa tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:45.329391 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-8c77f083-2284-4e6c-b34b-fdb5c06f55db tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2899039d-b3ca-488b-b808-026c69f98f82"}} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:29:45.330909 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-8c77f083-2284-4e6c-b34b-fdb5c06f55db tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 17641e09-70b6-4020-9fb5-31780056f2d9] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:45.343961 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8c77f083-2284-4e6c-b34b-fdb5c06f55db tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:45.346809 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8c77f083-2284-4e6c-b34b-fdb5c06f55db tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:45.347874 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8c77f083-2284-4e6c-b34b-fdb5c06f55db tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:45.348656 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8c77f083-2284-4e6c-b34b-fdb5c06f55db tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:45.640944 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-8a9f3c99-893a-4f1b-b27e-2cb7200110fa tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:45.654221 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-8a9f3c99-893a-4f1b-b27e-2cb7200110fa tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1369 microversion: 2.1 time: 0.501265 Jun 14 18:29:45.655209 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 139/304] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:45 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1369 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:29:45.789394 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-385f96f2-1b32-4523-8c39-d75cf780b989 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:45.790445 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-385f96f2-1b32-4523-8c39-d75cf780b989 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:45.805272 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-385f96f2-1b32-4523-8c39-d75cf780b989 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:45.806144 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-385f96f2-1b32-4523-8c39-d75cf780b989 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:45.808287 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-385f96f2-1b32-4523-8c39-d75cf780b989 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:45.808287 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-385f96f2-1b32-4523-8c39-d75cf780b989 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:46.078410 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-385f96f2-1b32-4523-8c39-d75cf780b989 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:46.087642 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-385f96f2-1b32-4523-8c39-d75cf780b989 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:46.094579 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-385f96f2-1b32-4523-8c39-d75cf780b989 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:46.096506 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-385f96f2-1b32-4523-8c39-d75cf780b989 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1740 microversion: 2.20 time: 0.313783 Jun 14 18:29:46.107468 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 140/305] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:29:45 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1740 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:29:46.524240 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-8c77f083-2284-4e6c-b34b-fdb5c06f55db tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "POST /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.198787 Jun 14 18:29:46.526718 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 166/306] 10.222.0.78 () {60 vars in 1322 bytes} [Tue Jun 14 18:29:45 2022] POST /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9/os-volume_attachments => generated 194 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:29:46.673910 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-58ebc3cf-8317-43ec-9f68-1d5f4afe79ac tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:46.675185 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-58ebc3cf-8317-43ec-9f68-1d5f4afe79ac tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:46.683823 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-58ebc3cf-8317-43ec-9f68-1d5f4afe79ac tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:46.684308 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-58ebc3cf-8317-43ec-9f68-1d5f4afe79ac tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:46.685084 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-58ebc3cf-8317-43ec-9f68-1d5f4afe79ac tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:46.685864 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-58ebc3cf-8317-43ec-9f68-1d5f4afe79ac tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:46.910143 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-58ebc3cf-8317-43ec-9f68-1d5f4afe79ac tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:46.919914 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-58ebc3cf-8317-43ec-9f68-1d5f4afe79ac tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1369 microversion: 2.1 time: 0.250079 Jun 14 18:29:46.920763 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 141/307] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:46 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1369 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:47.117217 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-947db248-4374-4e85-8000-5b049ae1f3cc tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:47.117929 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-947db248-4374-4e85-8000-5b049ae1f3cc tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:47.124846 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-947db248-4374-4e85-8000-5b049ae1f3cc tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:47.125291 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-947db248-4374-4e85-8000-5b049ae1f3cc tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:47.126090 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-947db248-4374-4e85-8000-5b049ae1f3cc tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:47.126517 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-947db248-4374-4e85-8000-5b049ae1f3cc tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:47.287657 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-947db248-4374-4e85-8000-5b049ae1f3cc tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:47.299998 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-947db248-4374-4e85-8000-5b049ae1f3cc tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:47.302040 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-947db248-4374-4e85-8000-5b049ae1f3cc tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:47.303462 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-947db248-4374-4e85-8000-5b049ae1f3cc tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1740 microversion: 2.20 time: 0.191552 Jun 14 18:29:47.304517 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 167/308] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:29:47 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1740 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:29:47.939326 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-3ce64203-f807-4622-9389-90fa054d0f37 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:47.940033 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-3ce64203-f807-4622-9389-90fa054d0f37 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:47.947870 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3ce64203-f807-4622-9389-90fa054d0f37 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:47.948300 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3ce64203-f807-4622-9389-90fa054d0f37 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:47.949027 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3ce64203-f807-4622-9389-90fa054d0f37 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:47.949487 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3ce64203-f807-4622-9389-90fa054d0f37 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:48.164269 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-3ce64203-f807-4622-9389-90fa054d0f37 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:48.173743 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-3ce64203-f807-4622-9389-90fa054d0f37 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1369 microversion: 2.1 time: 0.241188 Jun 14 18:29:48.174781 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 142/309] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:47 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1369 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:29:48.322893 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-42ece307-0987-4f77-91e1-53fb4c47b740 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:48.323643 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-42ece307-0987-4f77-91e1-53fb4c47b740 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:48.330645 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-42ece307-0987-4f77-91e1-53fb4c47b740 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:48.331101 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-42ece307-0987-4f77-91e1-53fb4c47b740 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:48.331882 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-42ece307-0987-4f77-91e1-53fb4c47b740 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:48.332323 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-42ece307-0987-4f77-91e1-53fb4c47b740 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:48.475906 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-42ece307-0987-4f77-91e1-53fb4c47b740 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:48.484740 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-42ece307-0987-4f77-91e1-53fb4c47b740 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:48.486273 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-42ece307-0987-4f77-91e1-53fb4c47b740 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:48.487435 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-42ece307-0987-4f77-91e1-53fb4c47b740 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1740 microversion: 2.20 time: 0.169425 Jun 14 18:29:48.493930 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 168/310] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:29:48 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:29:49.192906 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-419ed504-22a1-433d-a7d4-90e9a95694c5 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:49.193660 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-419ed504-22a1-433d-a7d4-90e9a95694c5 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:49.201242 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-419ed504-22a1-433d-a7d4-90e9a95694c5 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:49.201724 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-419ed504-22a1-433d-a7d4-90e9a95694c5 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:49.202493 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-419ed504-22a1-433d-a7d4-90e9a95694c5 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:49.202930 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-419ed504-22a1-433d-a7d4-90e9a95694c5 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:49.206992 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell1:SELECT=100 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:29:49.339077 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-419ed504-22a1-433d-a7d4-90e9a95694c5 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:49.346407 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-419ed504-22a1-433d-a7d4-90e9a95694c5 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1369 microversion: 2.1 time: 0.157470 Jun 14 18:29:49.346978 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 143/311] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:49 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1369 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:49.506347 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-955eb06c-7899-43ae-a2bc-aba95322cb8c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:49.507555 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-955eb06c-7899-43ae-a2bc-aba95322cb8c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:49.516127 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-955eb06c-7899-43ae-a2bc-aba95322cb8c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:49.516574 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-955eb06c-7899-43ae-a2bc-aba95322cb8c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:49.517334 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-955eb06c-7899-43ae-a2bc-aba95322cb8c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:49.517794 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-955eb06c-7899-43ae-a2bc-aba95322cb8c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:49.701755 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-955eb06c-7899-43ae-a2bc-aba95322cb8c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:49.717824 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-955eb06c-7899-43ae-a2bc-aba95322cb8c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:49.720905 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-955eb06c-7899-43ae-a2bc-aba95322cb8c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:49.723178 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-955eb06c-7899-43ae-a2bc-aba95322cb8c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1740 microversion: 2.20 time: 0.220628 Jun 14 18:29:49.724218 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 169/312] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:29:49 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1740 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:29:50.151332 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-3bc7f7e9-e08d-4338-b888-eff15d046fa6 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Action: 'create', calling method: .version_select at 0x7efe7149a700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-538505258", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMiN+ORoR+wHmNDFAB7f6QlrRlgDcof21v3CebLZwOyg2lTMpnxmnFuqRcphadEm16Xf9TdJxQRv4HrxYhC1wLyuV3ZGaZb6/0fIc9tM6gPFzUhFMOO7wiMK3wBDxoeNjQ=="}} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:29:50.194624 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.quota [None req-3bc7f7e9-e08d-4338-b888-eff15d046fa6 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Getting quotas for project 54fd905313ed4581a527fe3a6ebf7bba. Resources: {'key_pairs'} {{(pid=118623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:29:50.203728 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.quota [None req-3bc7f7e9-e08d-4338-b888-eff15d046fa6 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Getting quotas for user d48cebe37030401a9907025fa097a44a and project 54fd905313ed4581a527fe3a6ebf7bba. Resources: {'key_pairs'} {{(pid=118623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:29:50.313085 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-3bc7f7e9-e08d-4338-b888-eff15d046fa6 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.166149 Jun 14 18:29:50.325920 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 144/313] 10.222.0.78 () {60 vars in 1158 bytes} [Tue Jun 14 18:29:50 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:29:50.369881 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-96b328a1-adec-4e6f-b542-61d7ccad3727 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:50.370698 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-96b328a1-adec-4e6f-b542-61d7ccad3727 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:50.378359 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-96b328a1-adec-4e6f-b542-61d7ccad3727 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:50.382039 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-96b328a1-adec-4e6f-b542-61d7ccad3727 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:50.383512 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-96b328a1-adec-4e6f-b542-61d7ccad3727 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:50.383741 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-96b328a1-adec-4e6f-b542-61d7ccad3727 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:50.469339 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-5efadae8-eaf7-427b-b2fd-5256abd79cec tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1332779972", "imageRef": "b4b13cd6-6465-482e-821c-f4ff26f26214", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-538505258", "networks": [{"uuid": "bc89e178-aa0d-44e6-b82e-a33c04c68411"}]}} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:29:50.534303 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.network.neutron [None req-5efadae8-eaf7-427b-b2fd-5256abd79cec tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] validate_networks() for [('bc89e178-aa0d-44e6-b82e-a33c04c68411', None, None, None, None, None)] {{(pid=118623) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 18:29:50.553281 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-96b328a1-adec-4e6f-b542-61d7ccad3727 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:50.576522 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-96b328a1-adec-4e6f-b542-61d7ccad3727 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1369 microversion: 2.1 time: 0.211768 Jun 14 18:29:50.586527 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 170/314] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:50 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1369 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:50.742165 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-646abb27-de21-4676-948e-68cbdb7529b6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:50.742767 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-646abb27-de21-4676-948e-68cbdb7529b6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:50.757600 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-646abb27-de21-4676-948e-68cbdb7529b6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:50.758064 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-646abb27-de21-4676-948e-68cbdb7529b6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:50.759124 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-646abb27-de21-4676-948e-68cbdb7529b6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:50.760107 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-646abb27-de21-4676-948e-68cbdb7529b6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:50.941873 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-646abb27-de21-4676-948e-68cbdb7529b6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:50.956184 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-646abb27-de21-4676-948e-68cbdb7529b6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:50.957784 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-646abb27-de21-4676-948e-68cbdb7529b6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:50.959019 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-646abb27-de21-4676-948e-68cbdb7529b6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1740 microversion: 2.20 time: 0.220967 Jun 14 18:29:50.959592 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 171/315] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:29:50 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1740 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:29:51.023451 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-5efadae8-eaf7-427b-b2fd-5256abd79cec tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Flavor limits 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 18:29:51.023979 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-5efadae8-eaf7-427b-b2fd-5256abd79cec tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Image limits 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 18:29:51.024387 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-5efadae8-eaf7-427b-b2fd-5256abd79cec tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Flavor pref 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 18:29:51.024796 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-5efadae8-eaf7-427b-b2fd-5256abd79cec tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Image pref 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 18:29:51.026016 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-5efadae8-eaf7-427b-b2fd-5256abd79cec tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 18:29:51.036687 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5efadae8-eaf7-427b-b2fd-5256abd79cec tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:51.037137 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5efadae8-eaf7-427b-b2fd-5256abd79cec tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:51.037958 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5efadae8-eaf7-427b-b2fd-5256abd79cec tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:51.038396 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5efadae8-eaf7-427b-b2fd-5256abd79cec tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:51.055766 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.quota [None req-5efadae8-eaf7-427b-b2fd-5256abd79cec tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Getting quotas for project 54fd905313ed4581a527fe3a6ebf7bba. Resources: {'instances', 'cores', 'ram'} {{(pid=118623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:29:51.059897 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.quota [None req-5efadae8-eaf7-427b-b2fd-5256abd79cec tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Getting quotas for user d48cebe37030401a9907025fa097a44a and project 54fd905313ed4581a527fe3a6ebf7bba. Resources: {'instances', 'cores', 'ram'} {{(pid=118623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:29:51.070587 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-5efadae8-eaf7-427b-b2fd-5256abd79cec tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Going to run 1 instances... {{(pid=118623) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 18:29:51.073173 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-5efadae8-eaf7-427b-b2fd-5256abd79cec tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b4b13cd6-6465-482e-821c-f4ff26f26214',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118623) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 18:29:51.215927 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-5efadae8-eaf7-427b-b2fd-5256abd79cec tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.750488 Jun 14 18:29:51.216883 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 145/316] 10.222.0.78 () {60 vars in 1146 bytes} [Tue Jun 14 18:29:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 14 18:29:51.233705 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-fe531d09-dd22-46e9-aa0b-3434d65a7f56 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:51.234934 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-fe531d09-dd22-46e9-aa0b-3434d65a7f56 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:51.306550 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-fe531d09-dd22-46e9-aa0b-3434d65a7f56 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:51.314264 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-fe531d09-dd22-46e9-aa0b-3434d65a7f56 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1258 microversion: 2.1 time: 0.088130 Jun 14 18:29:51.315139 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 172/317] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:51 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1258 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:51.593965 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-466f2650-49ba-4315-a3b8-5f105488e920 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:51.594569 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-466f2650-49ba-4315-a3b8-5f105488e920 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:51.600682 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-466f2650-49ba-4315-a3b8-5f105488e920 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:51.601128 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-466f2650-49ba-4315-a3b8-5f105488e920 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:51.601945 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-466f2650-49ba-4315-a3b8-5f105488e920 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:51.602376 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-466f2650-49ba-4315-a3b8-5f105488e920 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:51.732305 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-466f2650-49ba-4315-a3b8-5f105488e920 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:51.739674 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-466f2650-49ba-4315-a3b8-5f105488e920 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1369 microversion: 2.1 time: 0.149594 Jun 14 18:29:51.740245 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 146/318] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:51 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:29:51.980626 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-f28bd021-8617-4bac-b476-83c5be2c83ea tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:51.981224 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-f28bd021-8617-4bac-b476-83c5be2c83ea tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:51.988556 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f28bd021-8617-4bac-b476-83c5be2c83ea tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:51.988975 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f28bd021-8617-4bac-b476-83c5be2c83ea tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:51.989760 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f28bd021-8617-4bac-b476-83c5be2c83ea tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:51.990181 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f28bd021-8617-4bac-b476-83c5be2c83ea tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:52.130092 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-f28bd021-8617-4bac-b476-83c5be2c83ea tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:52.134420 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:29:52.146523 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-f28bd021-8617-4bac-b476-83c5be2c83ea tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:52.148436 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-f28bd021-8617-4bac-b476-83c5be2c83ea tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:52.149845 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-f28bd021-8617-4bac-b476-83c5be2c83ea tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1740 microversion: 2.20 time: 0.173621 Jun 14 18:29:52.154434 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 173/319] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:29:51 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:29:52.332992 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-1b06d4d8-8246-4ce7-be69-c39acdd6e4b7 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:52.334283 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-1b06d4d8-8246-4ce7-be69-c39acdd6e4b7 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:52.387099 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-1b06d4d8-8246-4ce7-be69-c39acdd6e4b7 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:52.394136 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-1b06d4d8-8246-4ce7-be69-c39acdd6e4b7 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1258 microversion: 2.1 time: 0.065202 Jun 14 18:29:52.394707 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 147/320] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:52 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1258 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:29:52.756252 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-438c7913-ee5c-4914-aef8-2d2a3c8b75d1 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:52.756867 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-438c7913-ee5c-4914-aef8-2d2a3c8b75d1 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:52.764160 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-438c7913-ee5c-4914-aef8-2d2a3c8b75d1 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:52.764630 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-438c7913-ee5c-4914-aef8-2d2a3c8b75d1 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:52.765400 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-438c7913-ee5c-4914-aef8-2d2a3c8b75d1 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:52.765872 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-438c7913-ee5c-4914-aef8-2d2a3c8b75d1 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:52.899787 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-438c7913-ee5c-4914-aef8-2d2a3c8b75d1 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:52.907974 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-438c7913-ee5c-4914-aef8-2d2a3c8b75d1 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1369 microversion: 2.1 time: 0.155684 Jun 14 18:29:52.908544 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 174/321] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:52 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1369 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:53.170504 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-d9c579c5-47db-4506-99c5-6d9018503598 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:53.171113 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-d9c579c5-47db-4506-99c5-6d9018503598 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:53.177721 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d9c579c5-47db-4506-99c5-6d9018503598 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:53.178171 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d9c579c5-47db-4506-99c5-6d9018503598 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:53.178935 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d9c579c5-47db-4506-99c5-6d9018503598 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:53.179786 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d9c579c5-47db-4506-99c5-6d9018503598 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:53.316126 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-d9c579c5-47db-4506-99c5-6d9018503598 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:53.325129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-d9c579c5-47db-4506-99c5-6d9018503598 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:53.326722 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-d9c579c5-47db-4506-99c5-6d9018503598 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:53.327881 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-d9c579c5-47db-4506-99c5-6d9018503598 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1722 microversion: 2.20 time: 0.162182 Jun 14 18:29:53.328431 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 148/322] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:29:53 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:29:53.412294 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-c5fa1878-727f-4764-b8c0-9736845bcc6b tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:53.412900 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-c5fa1878-727f-4764-b8c0-9736845bcc6b tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:53.420148 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c5fa1878-727f-4764-b8c0-9736845bcc6b tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:53.420590 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c5fa1878-727f-4764-b8c0-9736845bcc6b tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:53.421357 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c5fa1878-727f-4764-b8c0-9736845bcc6b tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:53.421820 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c5fa1878-727f-4764-b8c0-9736845bcc6b tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:53.491808 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-c5fa1878-727f-4764-b8c0-9736845bcc6b tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:53.499890 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-c5fa1878-727f-4764-b8c0-9736845bcc6b tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1254 microversion: 2.1 time: 0.091756 Jun 14 18:29:53.500559 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 175/323] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:53 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1254 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:53.926080 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-103c80bc-acff-4711-84d5-14db24c249a9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:53.927737 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-103c80bc-acff-4711-84d5-14db24c249a9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:53.933823 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-103c80bc-acff-4711-84d5-14db24c249a9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:53.934278 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-103c80bc-acff-4711-84d5-14db24c249a9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:53.935063 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-103c80bc-acff-4711-84d5-14db24c249a9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:53.935619 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-103c80bc-acff-4711-84d5-14db24c249a9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:54.073261 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-103c80bc-acff-4711-84d5-14db24c249a9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:54.081503 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-103c80bc-acff-4711-84d5-14db24c249a9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1369 microversion: 2.1 time: 0.159333 Jun 14 18:29:54.082175 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 149/324] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:53 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1369 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:54.349571 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-7da1f28e-2856-47e2-98dd-f07dc92685fb tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:54.350094 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-7da1f28e-2856-47e2-98dd-f07dc92685fb tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:54.356534 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7da1f28e-2856-47e2-98dd-f07dc92685fb tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:54.357009 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7da1f28e-2856-47e2-98dd-f07dc92685fb tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:54.357891 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7da1f28e-2856-47e2-98dd-f07dc92685fb tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:54.358336 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7da1f28e-2856-47e2-98dd-f07dc92685fb tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:54.488756 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-7da1f28e-2856-47e2-98dd-f07dc92685fb tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:54.497385 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-7da1f28e-2856-47e2-98dd-f07dc92685fb tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:54.498955 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-7da1f28e-2856-47e2-98dd-f07dc92685fb tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:54.500103 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-7da1f28e-2856-47e2-98dd-f07dc92685fb tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1722 microversion: 2.20 time: 0.154641 Jun 14 18:29:54.500656 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 176/325] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:29:54 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:29:54.519397 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-8127362f-0dbd-42e5-af13-725f153989f9 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:54.520011 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-8127362f-0dbd-42e5-af13-725f153989f9 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:54.526124 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8127362f-0dbd-42e5-af13-725f153989f9 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:54.526574 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8127362f-0dbd-42e5-af13-725f153989f9 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:54.527333 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8127362f-0dbd-42e5-af13-725f153989f9 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:54.527772 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8127362f-0dbd-42e5-af13-725f153989f9 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:54.587043 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-8127362f-0dbd-42e5-af13-725f153989f9 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:54.595309 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-8127362f-0dbd-42e5-af13-725f153989f9 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1254 microversion: 2.1 time: 0.079839 Jun 14 18:29:54.595883 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 150/326] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:54 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1254 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:55.099801 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-f1045b03-db2a-4a4d-8940-bf4dcdface89 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:55.100413 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-f1045b03-db2a-4a4d-8940-bf4dcdface89 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:55.107117 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f1045b03-db2a-4a4d-8940-bf4dcdface89 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:55.107565 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f1045b03-db2a-4a4d-8940-bf4dcdface89 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:55.108318 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f1045b03-db2a-4a4d-8940-bf4dcdface89 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:55.108750 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f1045b03-db2a-4a4d-8940-bf4dcdface89 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:55.476398 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-f1045b03-db2a-4a4d-8940-bf4dcdface89 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:55.484624 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-f1045b03-db2a-4a4d-8940-bf4dcdface89 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1369 microversion: 2.1 time: 0.388871 Jun 14 18:29:55.488116 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 177/327] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:55 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1369 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:55.520459 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-d66ca59c-33a0-489c-b7e6-2c0e784d2b83 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:55.521051 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-d66ca59c-33a0-489c-b7e6-2c0e784d2b83 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:55.528976 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d66ca59c-33a0-489c-b7e6-2c0e784d2b83 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:55.528976 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d66ca59c-33a0-489c-b7e6-2c0e784d2b83 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:55.529407 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d66ca59c-33a0-489c-b7e6-2c0e784d2b83 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:55.529867 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d66ca59c-33a0-489c-b7e6-2c0e784d2b83 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:55.612908 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-02c35f99-19c4-47af-9878-f8773272b654 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:55.613681 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-02c35f99-19c4-47af-9878-f8773272b654 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:55.620620 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-02c35f99-19c4-47af-9878-f8773272b654 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:55.621167 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-02c35f99-19c4-47af-9878-f8773272b654 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:55.622655 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-02c35f99-19c4-47af-9878-f8773272b654 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:55.623192 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-02c35f99-19c4-47af-9878-f8773272b654 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:55.684886 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-d66ca59c-33a0-489c-b7e6-2c0e784d2b83 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:55.693886 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-d66ca59c-33a0-489c-b7e6-2c0e784d2b83 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:55.695602 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-d66ca59c-33a0-489c-b7e6-2c0e784d2b83 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:55.697300 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-d66ca59c-33a0-489c-b7e6-2c0e784d2b83 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1725 microversion: 2.20 time: 0.180866 Jun 14 18:29:55.698055 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 151/328] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:29:55 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:29:55.701763 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-02c35f99-19c4-47af-9878-f8773272b654 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:55.703585 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-4792dd90-5e4d-40b7-9ce6-5630ff7bb86c req-f86a8928-4230-4b59-85f8-1b77d4e52ec8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e66ffa48-038e-40ba-b075-bafc9eb4b015", "name": "network-vif-plugged", "status": "completed", "tag": "6e99f823-8a81-4709-b6d7-f5393c08507e"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:29:55.708186 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:29:55.720012 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-02c35f99-19c4-47af-9878-f8773272b654 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1310 microversion: 2.1 time: 0.102452 Jun 14 18:29:55.720012 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 178/329] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:55 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1310 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:29:55.720253 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-4792dd90-5e4d-40b7-9ce6-5630ff7bb86c req-f86a8928-4230-4b59-85f8-1b77d4e52ec8 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:55.720253 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-4792dd90-5e4d-40b7-9ce6-5630ff7bb86c req-f86a8928-4230-4b59-85f8-1b77d4e52ec8 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:55.720445 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-b8920fe2-c762-4bd1-9b07-943764f71c32 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3df88755-2057-435a-80ec-93e1de992588"}} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:29:55.720445 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-b8920fe2-c762-4bd1-9b07-943764f71c32 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:55.726732 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b8920fe2-c762-4bd1-9b07-943764f71c32 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:55.727189 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b8920fe2-c762-4bd1-9b07-943764f71c32 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:55.727972 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b8920fe2-c762-4bd1-9b07-943764f71c32 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:55.728413 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b8920fe2-c762-4bd1-9b07-943764f71c32 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:55.731798 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-4792dd90-5e4d-40b7-9ce6-5630ff7bb86c req-f86a8928-4230-4b59-85f8-1b77d4e52ec8 service nova] Creating event network-vif-plugged:6e99f823-8a81-4709-b6d7-f5393c08507e for instance e66ffa48-038e-40ba-b075-bafc9eb4b015 on hv-cinder-84456 Jun 14 18:29:55.737897 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-4792dd90-5e4d-40b7-9ce6-5630ff7bb86c req-f86a8928-4230-4b59-85f8-1b77d4e52ec8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037964 Jun 14 18:29:55.738586 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 152/330] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:29:56.059199 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-b2796c3e-3d67-458f-8c3d-3b5f87f51f8c tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1224458560", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1240575293", "security_groups": [{"name": "tempest-secgroup-smoke-659918853"}], "networks": [{"uuid": "39e41b5c-e704-4229-8e8f-5b4157b809d1"}], "block_device_mapping_v2": [{"uuid": "865fcd79-aa24-4fb2-91e9-2d7262cab3d7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:29:56.210554 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.network.neutron [None req-b2796c3e-3d67-458f-8c3d-3b5f87f51f8c tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] validate_networks() for [('39e41b5c-e704-4229-8e8f-5b4157b809d1', None, None, None, None, None)] {{(pid=118623) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 18:29:56.601335 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-b2796c3e-3d67-458f-8c3d-3b5f87f51f8c tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Flavor limits 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 18:29:56.601964 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-b2796c3e-3d67-458f-8c3d-3b5f87f51f8c tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Image limits 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 18:29:56.602261 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-b2796c3e-3d67-458f-8c3d-3b5f87f51f8c tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Flavor pref 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 18:29:56.602672 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-b2796c3e-3d67-458f-8c3d-3b5f87f51f8c tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Image pref 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 18:29:56.603078 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-b2796c3e-3d67-458f-8c3d-3b5f87f51f8c tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 18:29:56.612097 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b2796c3e-3d67-458f-8c3d-3b5f87f51f8c tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:56.612539 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b2796c3e-3d67-458f-8c3d-3b5f87f51f8c tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:56.613322 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b2796c3e-3d67-458f-8c3d-3b5f87f51f8c tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:56.613791 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b2796c3e-3d67-458f-8c3d-3b5f87f51f8c tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:56.632794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.quota [None req-b2796c3e-3d67-458f-8c3d-3b5f87f51f8c tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Getting quotas for project 437f86b97f3c4725955bc1f71017af5e. Resources: {'instances', 'cores', 'ram'} {{(pid=118623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:29:56.637953 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.quota [None req-b2796c3e-3d67-458f-8c3d-3b5f87f51f8c tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Getting quotas for user 48a00b33efb04f55b1d3c0a985536df2 and project 437f86b97f3c4725955bc1f71017af5e. Resources: {'instances', 'cores', 'ram'} {{(pid=118623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:29:56.694805 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-b2796c3e-3d67-458f-8c3d-3b5f87f51f8c tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Going to run 1 instances... {{(pid=118623) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 18:29:56.696981 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-b2796c3e-3d67-458f-8c3d-3b5f87f51f8c tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='865fcd79-aa24-4fb2-91e9-2d7262cab3d7',volume_size=None,volume_type=None)] {{(pid=118623) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 18:29:57.099984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-b8920fe2-c762-4bd1-9b07-943764f71c32 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "POST /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.384670 Jun 14 18:29:57.101017 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 179/331] 10.222.0.78 () {62 vars in 1363 bytes} [Tue Jun 14 18:29:55 2022] POST /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2/os-volume_attachments => generated 188 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 14 18:29:57.106578 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-a84621fa-5326-46e2-868b-5711be8c98b9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:57.109477 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-a84621fa-5326-46e2-868b-5711be8c98b9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:57.114516 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a84621fa-5326-46e2-868b-5711be8c98b9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:57.115045 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a84621fa-5326-46e2-868b-5711be8c98b9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:57.115998 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a84621fa-5326-46e2-868b-5711be8c98b9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:57.116495 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a84621fa-5326-46e2-868b-5711be8c98b9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:57.350254 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-b2796c3e-3d67-458f-8c3d-3b5f87f51f8c tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.296574 Jun 14 18:29:57.357208 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-a84621fa-5326-46e2-868b-5711be8c98b9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:57.357856 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 153/332] 10.222.0.78 () {60 vars in 1146 bytes} [Tue Jun 14 18:29:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 1305 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 14 18:29:57.365068 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-5e334806-c426-4e04-bb11-e60bec86e1e2 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:57.365956 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-a84621fa-5326-46e2-868b-5711be8c98b9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1369 microversion: 2.1 time: 0.263861 Jun 14 18:29:57.366294 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-5e334806-c426-4e04-bb11-e60bec86e1e2 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:57.375882 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 180/333] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:57 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1369 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:57.385104 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5e334806-c426-4e04-bb11-e60bec86e1e2 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:57.386007 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5e334806-c426-4e04-bb11-e60bec86e1e2 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:57.387097 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5e334806-c426-4e04-bb11-e60bec86e1e2 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:57.387097 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5e334806-c426-4e04-bb11-e60bec86e1e2 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:57.391425 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-21bda064-2add-43d5-825d-b63e8daa50a6 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:57.392178 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-21bda064-2add-43d5-825d-b63e8daa50a6 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:57.512808 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-5e334806-c426-4e04-bb11-e60bec86e1e2 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:57.528807 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-5e334806-c426-4e04-bb11-e60bec86e1e2 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1328 microversion: 2.1 time: 0.169141 Jun 14 18:29:57.530117 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 154/334] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:57 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1328 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:57.537351 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-b0157b3f-fb27-4afb-aeef-5f6fc5ea3c04 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:29:57.537971 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-b0157b3f-fb27-4afb-aeef-5f6fc5ea3c04 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:57.547835 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b0157b3f-fb27-4afb-aeef-5f6fc5ea3c04 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:57.548692 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b0157b3f-fb27-4afb-aeef-5f6fc5ea3c04 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:57.550620 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b0157b3f-fb27-4afb-aeef-5f6fc5ea3c04 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:57.551970 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b0157b3f-fb27-4afb-aeef-5f6fc5ea3c04 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:57.579126 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-21bda064-2add-43d5-825d-b63e8daa50a6 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:57.590313 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-21bda064-2add-43d5-825d-b63e8daa50a6 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1089 microversion: 2.1 time: 0.211152 Jun 14 18:29:57.591206 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 181/335] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:57 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1089 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:57.598700 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-1aad0feb-a726-425e-a01b-5bd670a8f91f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Action: 'create', calling method: .version_select at 0x7efe70497790>, body: {"keypair": {"name": "tempest-keypair-1881070328", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMf61UK3IP4ad5rRsVRguVi/C3aA5RY2Lt5GYnHb9Z/9vIvGIYyh0JnooXamTlF6luHA5FJ3nZg6dY6q8O+Qqx5zrvqRBp98b3KTTHpAUeeDNKGKnJlUVKQOVV9PKQd9qg=="}} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:29:57.616568 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.quota [None req-1aad0feb-a726-425e-a01b-5bd670a8f91f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Getting quotas for project 56f8367a52044e82a2c272da39e1bfd8. Resources: {'key_pairs'} {{(pid=118624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:29:57.622574 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.quota [None req-1aad0feb-a726-425e-a01b-5bd670a8f91f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Getting quotas for user 9254bd46822346009497b01d28314335 and project 56f8367a52044e82a2c272da39e1bfd8. Resources: {'key_pairs'} {{(pid=118624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:29:57.746303 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-1aad0feb-a726-425e-a01b-5bd670a8f91f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.152773 Jun 14 18:29:57.747212 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 182/336] 10.222.0.78 () {60 vars in 1158 bytes} [Tue Jun 14 18:29:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:29:57.756490 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-a38e92e1-c17b-4b94-8560-2db80d5cb2f8 req-5183b096-549c-4cd0-a30a-feab0119be82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2876875b-5dbe-4032-949a-3357292296a2", "name": "network-vif-unplugged", "status": "completed", "tag": "ee384335-560e-4f82-a137-0b23b61ff825"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:29:57.774863 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-a38e92e1-c17b-4b94-8560-2db80d5cb2f8 req-5183b096-549c-4cd0-a30a-feab0119be82 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:57.776522 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-a38e92e1-c17b-4b94-8560-2db80d5cb2f8 req-5183b096-549c-4cd0-a30a-feab0119be82 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:57.789894 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.compute.server_external_events [req-a38e92e1-c17b-4b94-8560-2db80d5cb2f8 req-5183b096-549c-4cd0-a30a-feab0119be82 service nova] Unable to find a host for instance 2876875b-5dbe-4032-949a-3357292296a2. Dropping event network-vif-unplugged {{(pid=118624) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 14 18:29:57.792036 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-a38e92e1-c17b-4b94-8560-2db80d5cb2f8 req-5183b096-549c-4cd0-a30a-feab0119be82 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.039784 Jun 14 18:29:57.796575 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 183/337] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 45 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 14 18:29:57.945691 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-b0157b3f-fb27-4afb-aeef-5f6fc5ea3c04 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "POST /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2/action" status: 202 len: 0 microversion: 2.20 time: 0.413372 Jun 14 18:29:57.946757 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 155/338] 10.222.0.78 () {62 vars in 1318 bytes} [Tue Jun 14 18:29:57 2022] POST /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2/action => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 14 18:29:57.956571 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-8246d195-ca00-4c55-bd71-b3b61b04a2fa tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:57.958417 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-8246d195-ca00-4c55-bd71-b3b61b04a2fa tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:57.967499 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8246d195-ca00-4c55-bd71-b3b61b04a2fa tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:57.974719 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8246d195-ca00-4c55-bd71-b3b61b04a2fa tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:57.976131 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8246d195-ca00-4c55-bd71-b3b61b04a2fa tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:57.977390 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8246d195-ca00-4c55-bd71-b3b61b04a2fa tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:58.218770 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-8246d195-ca00-4c55-bd71-b3b61b04a2fa tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:58.255933 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-8246d195-ca00-4c55-bd71-b3b61b04a2fa tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:58.258985 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-8246d195-ca00-4c55-bd71-b3b61b04a2fa tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:58.264937 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-8246d195-ca00-4c55-bd71-b3b61b04a2fa tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1751 microversion: 2.20 time: 0.313094 Jun 14 18:29:58.299447 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 184/339] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:29:57 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1751 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:29:58.384588 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-a262f1cd-9828-4897-b08f-1e35ea949c30 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:58.390300 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-a262f1cd-9828-4897-b08f-1e35ea949c30 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:58.397498 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a262f1cd-9828-4897-b08f-1e35ea949c30 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:58.398192 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a262f1cd-9828-4897-b08f-1e35ea949c30 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:58.399205 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a262f1cd-9828-4897-b08f-1e35ea949c30 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:58.399863 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a262f1cd-9828-4897-b08f-1e35ea949c30 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:58.548312 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-f0df4f98-959a-4386-8958-65b24b184c43 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:58.549068 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-f0df4f98-959a-4386-8958-65b24b184c43 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:58.557991 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f0df4f98-959a-4386-8958-65b24b184c43 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:58.558880 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f0df4f98-959a-4386-8958-65b24b184c43 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:58.560682 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f0df4f98-959a-4386-8958-65b24b184c43 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:58.561540 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f0df4f98-959a-4386-8958-65b24b184c43 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:58.627748 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-a262f1cd-9828-4897-b08f-1e35ea949c30 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:58.653375 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-a262f1cd-9828-4897-b08f-1e35ea949c30 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1369 microversion: 2.1 time: 0.272931 Jun 14 18:29:58.656256 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 156/340] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:58 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1369 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:58.667553 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-16e838fb-6700-498e-b7ce-6e5d92ef6d5d tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:58.668170 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-16e838fb-6700-498e-b7ce-6e5d92ef6d5d tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:58.755018 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-16e838fb-6700-498e-b7ce-6e5d92ef6d5d tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:58.765831 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-16e838fb-6700-498e-b7ce-6e5d92ef6d5d tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1089 microversion: 2.1 time: 0.107956 Jun 14 18:29:58.766816 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 157/341] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:58 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1089 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:58.792357 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-f0df4f98-959a-4386-8958-65b24b184c43 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:58.801562 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-f0df4f98-959a-4386-8958-65b24b184c43 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1358 microversion: 2.1 time: 0.257688 Jun 14 18:29:58.802119 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 185/342] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:58 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1358 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:29:59.348967 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-15118899-ffdb-4b0e-8f41-1fabf6809b4a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:59.349538 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-f00e3004-1fc3-4b0f-9e4d-5910e88fe15b req-34b36a25-1ad5-451d-82f3-ad9317cafc2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "023acd67-717e-45ef-abd2-936d81bbbccd", "tag": "9530bd2f-adfe-4346-b9ff-e6d39d227b3c"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:29:59.353385 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-15118899-ffdb-4b0e-8f41-1fabf6809b4a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:59.364643 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-f00e3004-1fc3-4b0f-9e4d-5910e88fe15b req-34b36a25-1ad5-451d-82f3-ad9317cafc2e service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:59.366772 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-f00e3004-1fc3-4b0f-9e4d-5910e88fe15b req-34b36a25-1ad5-451d-82f3-ad9317cafc2e service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:59.371733 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-15118899-ffdb-4b0e-8f41-1fabf6809b4a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:59.373254 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-15118899-ffdb-4b0e-8f41-1fabf6809b4a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:59.375694 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-15118899-ffdb-4b0e-8f41-1fabf6809b4a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:59.381584 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-15118899-ffdb-4b0e-8f41-1fabf6809b4a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:59.393312 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-f00e3004-1fc3-4b0f-9e4d-5910e88fe15b req-34b36a25-1ad5-451d-82f3-ad9317cafc2e service nova] Creating event network-changed:9530bd2f-adfe-4346-b9ff-e6d39d227b3c for instance 023acd67-717e-45ef-abd2-936d81bbbccd on hv-cinder-84456 Jun 14 18:29:59.399519 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-f00e3004-1fc3-4b0f-9e4d-5910e88fe15b req-34b36a25-1ad5-451d-82f3-ad9317cafc2e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054847 Jun 14 18:29:59.407478 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 186/343] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:29:59.609528 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-15118899-ffdb-4b0e-8f41-1fabf6809b4a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:59.619160 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-15118899-ffdb-4b0e-8f41-1fabf6809b4a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:59.620851 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-15118899-ffdb-4b0e-8f41-1fabf6809b4a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:59.622069 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-15118899-ffdb-4b0e-8f41-1fabf6809b4a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1751 microversion: 2.20 time: 0.314522 Jun 14 18:29:59.622617 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 158/344] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:29:59 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1751 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:29:59.673904 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-db65f6a7-de96-485f-b58a-978da90f4baf tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:59.674697 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-db65f6a7-de96-485f-b58a-978da90f4baf tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:59.681256 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-db65f6a7-de96-485f-b58a-978da90f4baf tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:59.681779 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-db65f6a7-de96-485f-b58a-978da90f4baf tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:59.683274 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-db65f6a7-de96-485f-b58a-978da90f4baf tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:59.683929 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-db65f6a7-de96-485f-b58a-978da90f4baf tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:59.785424 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-ad4cae0f-d071-4dba-87b2-3127b7f4e174 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:59.786167 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-ad4cae0f-d071-4dba-87b2-3127b7f4e174 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:59.793759 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ad4cae0f-d071-4dba-87b2-3127b7f4e174 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:59.794226 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ad4cae0f-d071-4dba-87b2-3127b7f4e174 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:59.795074 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ad4cae0f-d071-4dba-87b2-3127b7f4e174 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:59.795716 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ad4cae0f-d071-4dba-87b2-3127b7f4e174 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:59.858766 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-ad4cae0f-d071-4dba-87b2-3127b7f4e174 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:59.870354 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-ad4cae0f-d071-4dba-87b2-3127b7f4e174 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1139 microversion: 2.1 time: 0.087932 Jun 14 18:29:59.871497 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 159/345] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:59 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1139 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:29:59.879516 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-4442dcf5-e49e-449a-81a2-fcf875ba9fad tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:59.880694 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-4442dcf5-e49e-449a-81a2-fcf875ba9fad tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:59.891594 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4442dcf5-e49e-449a-81a2-fcf875ba9fad tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:59.892161 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4442dcf5-e49e-449a-81a2-fcf875ba9fad tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:59.892969 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4442dcf5-e49e-449a-81a2-fcf875ba9fad tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:59.893409 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4442dcf5-e49e-449a-81a2-fcf875ba9fad tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:59.922002 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-db65f6a7-de96-485f-b58a-978da90f4baf tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:29:59.930182 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-db65f6a7-de96-485f-b58a-978da90f4baf tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1562 microversion: 2.1 time: 0.261160 Jun 14 18:29:59.930758 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 187/346] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:59 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1562 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:29:59.958122 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-f0de2f10-e129-4bd9-9877-5cbe3db41de5 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:29:59.958617 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-f0de2f10-e129-4bd9-9877-5cbe3db41de5 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:29:59.965079 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f0de2f10-e129-4bd9-9877-5cbe3db41de5 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:59.965605 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f0de2f10-e129-4bd9-9877-5cbe3db41de5 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:29:59.966613 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f0de2f10-e129-4bd9-9877-5cbe3db41de5 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:29:59.967237 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f0de2f10-e129-4bd9-9877-5cbe3db41de5 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:00.048563 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-4442dcf5-e49e-449a-81a2-fcf875ba9fad tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:00.058185 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-4442dcf5-e49e-449a-81a2-fcf875ba9fad tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1358 microversion: 2.1 time: 0.184139 Jun 14 18:30:00.061853 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 160/347] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:29:59 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:00.081069 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-f0de2f10-e129-4bd9-9877-5cbe3db41de5 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.126837 Jun 14 18:30:00.082008 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 188/348] 10.222.0.78 () {58 vars in 1274 bytes} [Tue Jun 14 18:29:59 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:30:00.640900 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-09f4df6d-94d3-4ecb-9be0-a3131226663d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:00.641662 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-09f4df6d-94d3-4ecb-9be0-a3131226663d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:00.648580 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-09f4df6d-94d3-4ecb-9be0-a3131226663d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:00.649083 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-09f4df6d-94d3-4ecb-9be0-a3131226663d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:00.649909 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-09f4df6d-94d3-4ecb-9be0-a3131226663d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:00.650330 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-09f4df6d-94d3-4ecb-9be0-a3131226663d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:00.780470 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-09f4df6d-94d3-4ecb-9be0-a3131226663d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:00.789079 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-09f4df6d-94d3-4ecb-9be0-a3131226663d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:00.792417 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-09f4df6d-94d3-4ecb-9be0-a3131226663d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:00.793663 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-09f4df6d-94d3-4ecb-9be0-a3131226663d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1751 microversion: 2.20 time: 0.156787 Jun 14 18:30:00.794383 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 161/349] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:30:00 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:30:00.888508 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-435a4bd1-0ce2-4f1f-ae3d-4f7ce1849461 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:00.889106 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-435a4bd1-0ce2-4f1f-ae3d-4f7ce1849461 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:00.895838 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-435a4bd1-0ce2-4f1f-ae3d-4f7ce1849461 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:00.896282 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-435a4bd1-0ce2-4f1f-ae3d-4f7ce1849461 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:00.897144 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-435a4bd1-0ce2-4f1f-ae3d-4f7ce1849461 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:00.897489 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-435a4bd1-0ce2-4f1f-ae3d-4f7ce1849461 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:00.971131 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-435a4bd1-0ce2-4f1f-ae3d-4f7ce1849461 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:00.980216 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-435a4bd1-0ce2-4f1f-ae3d-4f7ce1849461 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1139 microversion: 2.1 time: 0.095957 Jun 14 18:30:00.980679 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 189/350] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:00 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1139 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:01.078932 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-b7826f25-9447-42d3-8d84-3570bc88424b tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:01.079874 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-b7826f25-9447-42d3-8d84-3570bc88424b tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:01.087164 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b7826f25-9447-42d3-8d84-3570bc88424b tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:01.088171 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b7826f25-9447-42d3-8d84-3570bc88424b tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:01.089785 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b7826f25-9447-42d3-8d84-3570bc88424b tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:01.093754 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b7826f25-9447-42d3-8d84-3570bc88424b tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:01.123325 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-c139a2b0-0729-4fd8-b44c-115dcd25077f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-347600536", "imageRef": "e2555120-8576-4128-944f-40805aa95a9b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e21b4aaa-368c-485d-acb4-337720920cc4"}], "security_groups": [{"name": "tempest-securitygroup--1284982780"}], "key_name": "tempest-keypair-1881070328", "user_data": "}} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:30:01.258291 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-b7826f25-9447-42d3-8d84-3570bc88424b tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:01.268624 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-b7826f25-9447-42d3-8d84-3570bc88424b tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1358 microversion: 2.1 time: 0.196385 Jun 14 18:30:01.270278 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 162/351] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:01 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:01.620764 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.network.neutron [None req-c139a2b0-0729-4fd8-b44c-115dcd25077f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] validate_networks() for [('e21b4aaa-368c-485d-acb4-337720920cc4', None, None, None, None, None)] {{(pid=118624) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 18:30:01.799212 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-f6a8373b-048f-42f8-b666-bb997aefbab3 req-afd56c64-b346-4a86-a8f6-ce785c2ebe56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e66ffa48-038e-40ba-b075-bafc9eb4b015", "tag": "6e99f823-8a81-4709-b6d7-f5393c08507e"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:30:01.815658 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-f6a8373b-048f-42f8-b666-bb997aefbab3 req-afd56c64-b346-4a86-a8f6-ce785c2ebe56 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:01.816397 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-f6a8373b-048f-42f8-b666-bb997aefbab3 req-afd56c64-b346-4a86-a8f6-ce785c2ebe56 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:01.841157 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-f6a8373b-048f-42f8-b666-bb997aefbab3 req-afd56c64-b346-4a86-a8f6-ce785c2ebe56 service nova] Creating event network-changed:6e99f823-8a81-4709-b6d7-f5393c08507e for instance e66ffa48-038e-40ba-b075-bafc9eb4b015 on hv-cinder-84456 Jun 14 18:30:01.856289 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-f6a8373b-048f-42f8-b666-bb997aefbab3 req-afd56c64-b346-4a86-a8f6-ce785c2ebe56 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060587 Jun 14 18:30:01.861925 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 163/352] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:30:01.876857 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-e57651b4-9f1c-4d1b-af92-65289d849775 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:01.876857 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-e57651b4-9f1c-4d1b-af92-65289d849775 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:01.896994 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e57651b4-9f1c-4d1b-af92-65289d849775 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:01.897482 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e57651b4-9f1c-4d1b-af92-65289d849775 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:01.898282 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e57651b4-9f1c-4d1b-af92-65289d849775 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:01.898728 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e57651b4-9f1c-4d1b-af92-65289d849775 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:01.952767 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:30:02.119198 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-e57651b4-9f1c-4d1b-af92-65289d849775 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:02.132511 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-e57651b4-9f1c-4d1b-af92-65289d849775 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:02.134800 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-e57651b4-9f1c-4d1b-af92-65289d849775 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:02.137012 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-e57651b4-9f1c-4d1b-af92-65289d849775 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1751 microversion: 2.20 time: 0.273593 Jun 14 18:30:02.137611 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 164/353] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:30:01 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1751 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:30:02.144694 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-739b7b6a-bb60-427d-ae16-49ffe1d369ea tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:02.145918 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-739b7b6a-bb60-427d-ae16-49ffe1d369ea tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:02.156755 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-739b7b6a-bb60-427d-ae16-49ffe1d369ea tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:02.157335 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-739b7b6a-bb60-427d-ae16-49ffe1d369ea tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:02.158366 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-739b7b6a-bb60-427d-ae16-49ffe1d369ea tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:02.158898 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-739b7b6a-bb60-427d-ae16-49ffe1d369ea tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:02.197182 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-c139a2b0-0729-4fd8-b44c-115dcd25077f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Flavor limits 0:0:0 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 18:30:02.197696 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-c139a2b0-0729-4fd8-b44c-115dcd25077f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Image limits 0:0:0 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 18:30:02.198574 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-c139a2b0-0729-4fd8-b44c-115dcd25077f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Flavor pref 0:0:0 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 18:30:02.199042 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-c139a2b0-0729-4fd8-b44c-115dcd25077f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Image pref 0:0:0 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 18:30:02.199461 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-c139a2b0-0729-4fd8-b44c-115dcd25077f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 18:30:02.227621 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c139a2b0-0729-4fd8-b44c-115dcd25077f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:02.230197 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c139a2b0-0729-4fd8-b44c-115dcd25077f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:02.230197 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c139a2b0-0729-4fd8-b44c-115dcd25077f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:02.230197 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c139a2b0-0729-4fd8-b44c-115dcd25077f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:02.250374 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.quota [None req-c139a2b0-0729-4fd8-b44c-115dcd25077f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Getting quotas for project 56f8367a52044e82a2c272da39e1bfd8. Resources: {'instances', 'cores', 'ram'} {{(pid=118624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:30:02.255750 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-739b7b6a-bb60-427d-ae16-49ffe1d369ea tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:02.264788 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-739b7b6a-bb60-427d-ae16-49ffe1d369ea tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1139 microversion: 2.1 time: 0.125971 Jun 14 18:30:02.266051 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 165/354] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:02 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1139 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:02.276522 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.quota [None req-c139a2b0-0729-4fd8-b44c-115dcd25077f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Getting quotas for user 9254bd46822346009497b01d28314335 and project 56f8367a52044e82a2c272da39e1bfd8. Resources: {'instances', 'cores', 'ram'} {{(pid=118624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:30:02.297813 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-a2a91f65-8a01-41bd-a9de-868c18c0f43d tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:02.299263 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-a2a91f65-8a01-41bd-a9de-868c18c0f43d tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:02.307074 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-c139a2b0-0729-4fd8-b44c-115dcd25077f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Going to run 1 instances... {{(pid=118624) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 18:30:02.314094 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-c139a2b0-0729-4fd8-b44c-115dcd25077f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e2555120-8576-4128-944f-40805aa95a9b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118624) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 18:30:02.315198 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a2a91f65-8a01-41bd-a9de-868c18c0f43d tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:02.321877 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a2a91f65-8a01-41bd-a9de-868c18c0f43d tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:02.325113 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a2a91f65-8a01-41bd-a9de-868c18c0f43d tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:02.333303 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a2a91f65-8a01-41bd-a9de-868c18c0f43d tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:02.505276 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-c139a2b0-0729-4fd8-b44c-115dcd25077f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.386502 Jun 14 18:30:02.506332 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 190/355] 10.222.0.78 () {60 vars in 1146 bytes} [Tue Jun 14 18:30:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 1388 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 14 18:30:02.520847 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-0d9a51be-17be-4729-a2ba-335e8347ae96 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:02.522872 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-0d9a51be-17be-4729-a2ba-335e8347ae96 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:02.540140 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:30:02.585766 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-a2a91f65-8a01-41bd-a9de-868c18c0f43d tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:02.604707 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-a2a91f65-8a01-41bd-a9de-868c18c0f43d tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1358 microversion: 2.1 time: 0.320545 Jun 14 18:30:02.615179 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 166/356] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:02 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1358 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:02.643291 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-0d9a51be-17be-4729-a2ba-335e8347ae96 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:02.655227 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-0d9a51be-17be-4729-a2ba-335e8347ae96 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726" status: 200 len: 1241 microversion: 2.1 time: 0.141105 Jun 14 18:30:02.657492 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 191/357] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:02 2022] GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 => generated 1241 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:03.156843 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-6fe972b3-6b21-42fe-bc46-064244e2ff96 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:03.158698 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-6fe972b3-6b21-42fe-bc46-064244e2ff96 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:03.168649 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6fe972b3-6b21-42fe-bc46-064244e2ff96 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:03.169337 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6fe972b3-6b21-42fe-bc46-064244e2ff96 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:03.170367 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6fe972b3-6b21-42fe-bc46-064244e2ff96 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:03.170913 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6fe972b3-6b21-42fe-bc46-064244e2ff96 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:03.297828 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-54f9281c-3e0f-4b86-8668-cf49c95777aa tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:03.298824 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-54f9281c-3e0f-4b86-8668-cf49c95777aa tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:03.317546 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-54f9281c-3e0f-4b86-8668-cf49c95777aa tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:03.318000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-54f9281c-3e0f-4b86-8668-cf49c95777aa tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:03.320065 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-54f9281c-3e0f-4b86-8668-cf49c95777aa tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:03.320590 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-54f9281c-3e0f-4b86-8668-cf49c95777aa tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:03.430902 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-54f9281c-3e0f-4b86-8668-cf49c95777aa tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:03.450458 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-54f9281c-3e0f-4b86-8668-cf49c95777aa tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1139 microversion: 2.1 time: 0.164629 Jun 14 18:30:03.461663 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 192/358] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:03 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1139 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:03.471919 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-6fe972b3-6b21-42fe-bc46-064244e2ff96 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:03.483922 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-6fe972b3-6b21-42fe-bc46-064244e2ff96 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:03.485897 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-6fe972b3-6b21-42fe-bc46-064244e2ff96 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:03.497943 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-6fe972b3-6b21-42fe-bc46-064244e2ff96 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1751 microversion: 2.20 time: 0.346401 Jun 14 18:30:03.499045 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 167/359] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:30:03 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1751 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:30:03.623320 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-19f133cc-1a5b-4fc1-b904-0417fa549a32 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:03.624089 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-19f133cc-1a5b-4fc1-b904-0417fa549a32 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:03.636618 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-19f133cc-1a5b-4fc1-b904-0417fa549a32 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:03.640621 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-19f133cc-1a5b-4fc1-b904-0417fa549a32 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:03.640621 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-19f133cc-1a5b-4fc1-b904-0417fa549a32 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:03.640621 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-19f133cc-1a5b-4fc1-b904-0417fa549a32 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:03.647081 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:30:03.675012 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-daec986a-1cbc-4f71-a285-80d60e3b94b1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:03.675703 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-daec986a-1cbc-4f71-a285-80d60e3b94b1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:03.695619 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-daec986a-1cbc-4f71-a285-80d60e3b94b1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:03.695619 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-daec986a-1cbc-4f71-a285-80d60e3b94b1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:03.695619 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-daec986a-1cbc-4f71-a285-80d60e3b94b1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:03.695619 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-daec986a-1cbc-4f71-a285-80d60e3b94b1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:03.816679 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-daec986a-1cbc-4f71-a285-80d60e3b94b1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:03.825883 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-daec986a-1cbc-4f71-a285-80d60e3b94b1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726" status: 200 len: 1245 microversion: 2.1 time: 0.155602 Jun 14 18:30:03.826668 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 168/360] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:03 2022] GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 => generated 1245 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:30:03.851480 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-19f133cc-1a5b-4fc1-b904-0417fa549a32 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:03.863131 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-19f133cc-1a5b-4fc1-b904-0417fa549a32 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1358 microversion: 2.1 time: 0.244129 Jun 14 18:30:03.863940 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 193/361] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:03 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:04.472021 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-6fcf07e9-3106-46d4-9b2f-8d862b703788 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:04.473294 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-6fcf07e9-3106-46d4-9b2f-8d862b703788 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:04.480772 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6fcf07e9-3106-46d4-9b2f-8d862b703788 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:04.481130 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6fcf07e9-3106-46d4-9b2f-8d862b703788 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:04.481930 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6fcf07e9-3106-46d4-9b2f-8d862b703788 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:04.482363 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6fcf07e9-3106-46d4-9b2f-8d862b703788 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:04.516230 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-db38f67b-ec66-4864-99bd-9c3d97472990 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:04.516921 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-db38f67b-ec66-4864-99bd-9c3d97472990 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:04.524942 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-db38f67b-ec66-4864-99bd-9c3d97472990 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:04.525385 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-db38f67b-ec66-4864-99bd-9c3d97472990 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:04.531672 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-db38f67b-ec66-4864-99bd-9c3d97472990 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:04.532111 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-db38f67b-ec66-4864-99bd-9c3d97472990 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:04.561442 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-6fcf07e9-3106-46d4-9b2f-8d862b703788 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:04.571231 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-6fcf07e9-3106-46d4-9b2f-8d862b703788 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1139 microversion: 2.1 time: 0.103285 Jun 14 18:30:04.572266 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 169/362] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:04 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1139 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:30:04.706551 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-db38f67b-ec66-4864-99bd-9c3d97472990 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:04.720998 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-db38f67b-ec66-4864-99bd-9c3d97472990 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:04.722554 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-db38f67b-ec66-4864-99bd-9c3d97472990 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:04.723728 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-db38f67b-ec66-4864-99bd-9c3d97472990 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1751 microversion: 2.20 time: 0.211382 Jun 14 18:30:04.724282 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 194/363] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:30:04 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1751 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:30:04.843447 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-a1e00cc0-3977-403c-b5a1-e2b787861fce tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:04.844083 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-a1e00cc0-3977-403c-b5a1-e2b787861fce tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:04.851001 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a1e00cc0-3977-403c-b5a1-e2b787861fce tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:04.851673 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a1e00cc0-3977-403c-b5a1-e2b787861fce tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:04.852645 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a1e00cc0-3977-403c-b5a1-e2b787861fce tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:04.853300 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a1e00cc0-3977-403c-b5a1-e2b787861fce tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:04.881535 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-faef5fb4-3fab-4451-ae2a-bdd05e2c8d56 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:04.886366 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-faef5fb4-3fab-4451-ae2a-bdd05e2c8d56 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:04.896143 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-faef5fb4-3fab-4451-ae2a-bdd05e2c8d56 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:04.896616 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-faef5fb4-3fab-4451-ae2a-bdd05e2c8d56 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:04.903218 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-faef5fb4-3fab-4451-ae2a-bdd05e2c8d56 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:04.909478 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-faef5fb4-3fab-4451-ae2a-bdd05e2c8d56 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:04.935838 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-a1e00cc0-3977-403c-b5a1-e2b787861fce tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:04.954842 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-a1e00cc0-3977-403c-b5a1-e2b787861fce tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726" status: 200 len: 1245 microversion: 2.1 time: 0.116117 Jun 14 18:30:04.956313 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 170/364] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:04 2022] GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 => generated 1245 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:05.105586 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-faef5fb4-3fab-4451-ae2a-bdd05e2c8d56 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:05.114543 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-faef5fb4-3fab-4451-ae2a-bdd05e2c8d56 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1358 microversion: 2.1 time: 0.236947 Jun 14 18:30:05.117509 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 195/365] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:04 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1358 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:30:05.593746 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-f66757f0-1c6e-48fc-83be-aec9b1dfcce2 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:05.595034 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-f66757f0-1c6e-48fc-83be-aec9b1dfcce2 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:05.601871 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f66757f0-1c6e-48fc-83be-aec9b1dfcce2 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:05.602316 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f66757f0-1c6e-48fc-83be-aec9b1dfcce2 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:05.603269 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f66757f0-1c6e-48fc-83be-aec9b1dfcce2 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:05.603893 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f66757f0-1c6e-48fc-83be-aec9b1dfcce2 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:05.672551 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-f66757f0-1c6e-48fc-83be-aec9b1dfcce2 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:05.681630 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-f66757f0-1c6e-48fc-83be-aec9b1dfcce2 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1139 microversion: 2.1 time: 0.094778 Jun 14 18:30:05.684405 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 171/366] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:05 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1139 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:05.741774 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-5010d4ac-8515-481f-a81b-eff3b305071b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:05.742418 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-5010d4ac-8515-481f-a81b-eff3b305071b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:05.750119 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5010d4ac-8515-481f-a81b-eff3b305071b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:05.750571 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5010d4ac-8515-481f-a81b-eff3b305071b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:05.751353 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5010d4ac-8515-481f-a81b-eff3b305071b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:05.751789 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5010d4ac-8515-481f-a81b-eff3b305071b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:05.890372 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-5010d4ac-8515-481f-a81b-eff3b305071b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:05.906060 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-5010d4ac-8515-481f-a81b-eff3b305071b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:05.910543 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-5010d4ac-8515-481f-a81b-eff3b305071b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:05.911124 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-5010d4ac-8515-481f-a81b-eff3b305071b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1751 microversion: 2.20 time: 0.173083 Jun 14 18:30:05.912110 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 196/367] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:30:05 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:30:05.980367 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-b7d546cc-500b-4671-9075-399ca6e0f70f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:05.980367 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-b7d546cc-500b-4671-9075-399ca6e0f70f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:05.982001 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b7d546cc-500b-4671-9075-399ca6e0f70f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:05.982462 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b7d546cc-500b-4671-9075-399ca6e0f70f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:05.983384 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b7d546cc-500b-4671-9075-399ca6e0f70f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:05.983740 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b7d546cc-500b-4671-9075-399ca6e0f70f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:06.058267 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-b7d546cc-500b-4671-9075-399ca6e0f70f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:06.066196 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-b7d546cc-500b-4671-9075-399ca6e0f70f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726" status: 200 len: 1245 microversion: 2.1 time: 0.096418 Jun 14 18:30:06.066943 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 172/368] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:05 2022] GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 => generated 1245 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:06.132542 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-11bc236a-d7fa-4dec-a961-3369e1d1f82d tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:06.133193 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-11bc236a-d7fa-4dec-a961-3369e1d1f82d tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:06.139954 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-11bc236a-d7fa-4dec-a961-3369e1d1f82d tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:06.140407 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-11bc236a-d7fa-4dec-a961-3369e1d1f82d tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:06.141189 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-11bc236a-d7fa-4dec-a961-3369e1d1f82d tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:06.141682 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-11bc236a-d7fa-4dec-a961-3369e1d1f82d tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:06.305760 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-11bc236a-d7fa-4dec-a961-3369e1d1f82d tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:06.316633 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-11bc236a-d7fa-4dec-a961-3369e1d1f82d tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1358 microversion: 2.1 time: 0.187865 Jun 14 18:30:06.320083 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 197/369] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:06 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:06.702123 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-7fbd0c35-fe87-4ea6-b943-245fc4af4992 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:06.702782 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-7fbd0c35-fe87-4ea6-b943-245fc4af4992 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:06.706507 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell0:SELECT=4 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:30:06.710740 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7fbd0c35-fe87-4ea6-b943-245fc4af4992 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:06.711411 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7fbd0c35-fe87-4ea6-b943-245fc4af4992 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:06.712186 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7fbd0c35-fe87-4ea6-b943-245fc4af4992 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:06.713129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7fbd0c35-fe87-4ea6-b943-245fc4af4992 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:06.841072 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-7fbd0c35-fe87-4ea6-b943-245fc4af4992 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:06.847518 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-7fbd0c35-fe87-4ea6-b943-245fc4af4992 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1139 microversion: 2.1 time: 0.150802 Jun 14 18:30:06.848267 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 173/370] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:06 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1139 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:06.949023 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-eff82fc7-40a1-4846-864d-48a2d0bfeec0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:06.949667 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-eff82fc7-40a1-4846-864d-48a2d0bfeec0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:06.957130 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-eff82fc7-40a1-4846-864d-48a2d0bfeec0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:06.957820 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-eff82fc7-40a1-4846-864d-48a2d0bfeec0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:06.963965 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-eff82fc7-40a1-4846-864d-48a2d0bfeec0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:06.963965 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-eff82fc7-40a1-4846-864d-48a2d0bfeec0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:07.088940 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-42385b4c-e538-462c-a2e1-e6f9796df012 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:07.090719 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-42385b4c-e538-462c-a2e1-e6f9796df012 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:07.122794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-42385b4c-e538-462c-a2e1-e6f9796df012 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:07.123858 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-42385b4c-e538-462c-a2e1-e6f9796df012 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:07.124700 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-42385b4c-e538-462c-a2e1-e6f9796df012 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:07.125144 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-42385b4c-e538-462c-a2e1-e6f9796df012 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:07.268075 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-eff82fc7-40a1-4846-864d-48a2d0bfeec0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:07.287661 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-eff82fc7-40a1-4846-864d-48a2d0bfeec0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:07.293748 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-eff82fc7-40a1-4846-864d-48a2d0bfeec0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:07.295547 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-eff82fc7-40a1-4846-864d-48a2d0bfeec0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1751 microversion: 2.20 time: 0.359993 Jun 14 18:30:07.299069 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 198/371] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:30:06 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1751 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:30:07.335026 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-747607d9-bbd5-40ce-8b8d-58f5f137164b tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:07.336118 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-747607d9-bbd5-40ce-8b8d-58f5f137164b tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:07.355925 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-747607d9-bbd5-40ce-8b8d-58f5f137164b tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:07.362768 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-747607d9-bbd5-40ce-8b8d-58f5f137164b tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:07.366698 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-747607d9-bbd5-40ce-8b8d-58f5f137164b tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:07.366698 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-747607d9-bbd5-40ce-8b8d-58f5f137164b tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:07.611386 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-747607d9-bbd5-40ce-8b8d-58f5f137164b tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:07.620150 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-747607d9-bbd5-40ce-8b8d-58f5f137164b tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1358 microversion: 2.1 time: 0.289328 Jun 14 18:30:07.625784 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 199/372] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:07 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1358 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:07.636178 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-42385b4c-e538-462c-a2e1-e6f9796df012 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:07.648339 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-42385b4c-e538-462c-a2e1-e6f9796df012 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726" status: 200 len: 1245 microversion: 2.1 time: 0.566080 Jun 14 18:30:07.649026 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 174/373] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:07 2022] GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 => generated 1245 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:07.866693 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-49c3b0d6-1f02-4282-844b-46cacf24e17c tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:07.867221 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-49c3b0d6-1f02-4282-844b-46cacf24e17c tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:07.875071 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-49c3b0d6-1f02-4282-844b-46cacf24e17c tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:07.875527 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-49c3b0d6-1f02-4282-844b-46cacf24e17c tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:07.876304 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-49c3b0d6-1f02-4282-844b-46cacf24e17c tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:07.876738 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-49c3b0d6-1f02-4282-844b-46cacf24e17c tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:07.942999 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-49c3b0d6-1f02-4282-844b-46cacf24e17c tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:07.951759 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-49c3b0d6-1f02-4282-844b-46cacf24e17c tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1139 microversion: 2.1 time: 0.089290 Jun 14 18:30:07.953407 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 200/374] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:07 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1139 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:08.317677 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-f5c7a060-9dc1-4b07-9139-ba2fc3cf226d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:08.318396 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-f5c7a060-9dc1-4b07-9139-ba2fc3cf226d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:08.326083 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f5c7a060-9dc1-4b07-9139-ba2fc3cf226d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:08.326630 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f5c7a060-9dc1-4b07-9139-ba2fc3cf226d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:08.327483 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f5c7a060-9dc1-4b07-9139-ba2fc3cf226d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:08.327991 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f5c7a060-9dc1-4b07-9139-ba2fc3cf226d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:08.472381 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-f5c7a060-9dc1-4b07-9139-ba2fc3cf226d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:08.484108 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-f5c7a060-9dc1-4b07-9139-ba2fc3cf226d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:08.487262 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-f5c7a060-9dc1-4b07-9139-ba2fc3cf226d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:08.487262 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-f5c7a060-9dc1-4b07-9139-ba2fc3cf226d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1751 microversion: 2.20 time: 0.173244 Jun 14 18:30:08.501545 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 175/375] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:30:08 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1751 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:30:08.636632 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-e010ad56-99c2-4059-99b1-79a528ef89ac tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:08.637352 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-e010ad56-99c2-4059-99b1-79a528ef89ac tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:08.644247 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e010ad56-99c2-4059-99b1-79a528ef89ac tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:08.644733 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e010ad56-99c2-4059-99b1-79a528ef89ac tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:08.645538 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e010ad56-99c2-4059-99b1-79a528ef89ac tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:08.645980 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e010ad56-99c2-4059-99b1-79a528ef89ac tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:08.664663 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-8a950d5c-3e4b-4452-864c-a0549f2eaaa6 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:08.665414 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-8a950d5c-3e4b-4452-864c-a0549f2eaaa6 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:08.672461 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8a950d5c-3e4b-4452-864c-a0549f2eaaa6 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:08.672900 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8a950d5c-3e4b-4452-864c-a0549f2eaaa6 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:08.673683 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8a950d5c-3e4b-4452-864c-a0549f2eaaa6 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:08.674117 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8a950d5c-3e4b-4452-864c-a0549f2eaaa6 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:08.733605 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-8a950d5c-3e4b-4452-864c-a0549f2eaaa6 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:08.741320 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-8a950d5c-3e4b-4452-864c-a0549f2eaaa6 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726" status: 200 len: 1245 microversion: 2.1 time: 0.080384 Jun 14 18:30:08.741912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 176/376] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:08 2022] GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:30:08.775002 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-e010ad56-99c2-4059-99b1-79a528ef89ac tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:08.783173 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-e010ad56-99c2-4059-99b1-79a528ef89ac tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1358 microversion: 2.1 time: 0.150892 Jun 14 18:30:08.783708 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 201/377] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:08 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:08.969371 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-8d7da5b0-8b38-4b3d-ad37-ae5f02cdeef7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:08.970004 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-8d7da5b0-8b38-4b3d-ad37-ae5f02cdeef7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:08.971965 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell0:SELECT=20 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:30:08.977847 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8d7da5b0-8b38-4b3d-ad37-ae5f02cdeef7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:08.978223 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8d7da5b0-8b38-4b3d-ad37-ae5f02cdeef7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:08.979712 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8d7da5b0-8b38-4b3d-ad37-ae5f02cdeef7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:08.980139 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8d7da5b0-8b38-4b3d-ad37-ae5f02cdeef7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:09.045549 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-8d7da5b0-8b38-4b3d-ad37-ae5f02cdeef7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:09.053697 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-8d7da5b0-8b38-4b3d-ad37-ae5f02cdeef7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1139 microversion: 2.1 time: 0.088069 Jun 14 18:30:09.054273 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 177/378] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:08 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1139 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:30:09.507385 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-3efd3055-e156-4999-b5ac-84025fe7fbc7 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:09.507990 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-3efd3055-e156-4999-b5ac-84025fe7fbc7 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:09.515079 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3efd3055-e156-4999-b5ac-84025fe7fbc7 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:09.515478 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3efd3055-e156-4999-b5ac-84025fe7fbc7 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:09.516231 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3efd3055-e156-4999-b5ac-84025fe7fbc7 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:09.516660 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3efd3055-e156-4999-b5ac-84025fe7fbc7 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:09.647237 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-3efd3055-e156-4999-b5ac-84025fe7fbc7 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:09.656503 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-3efd3055-e156-4999-b5ac-84025fe7fbc7 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:09.658037 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-3efd3055-e156-4999-b5ac-84025fe7fbc7 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:09.659183 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-3efd3055-e156-4999-b5ac-84025fe7fbc7 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1751 microversion: 2.20 time: 0.155686 Jun 14 18:30:09.659746 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 202/379] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:30:09 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:30:09.758804 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-62c337e4-59ed-4268-a590-e24cce7f3269 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:09.759414 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-62c337e4-59ed-4268-a590-e24cce7f3269 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:09.766875 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-62c337e4-59ed-4268-a590-e24cce7f3269 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:09.767250 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-62c337e4-59ed-4268-a590-e24cce7f3269 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:09.768013 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-62c337e4-59ed-4268-a590-e24cce7f3269 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:09.768442 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-62c337e4-59ed-4268-a590-e24cce7f3269 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:09.800053 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-b0097954-30aa-4b8f-8211-b213524f5929 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:09.800764 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-b0097954-30aa-4b8f-8211-b213524f5929 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:09.807390 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b0097954-30aa-4b8f-8211-b213524f5929 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:09.807827 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b0097954-30aa-4b8f-8211-b213524f5929 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:09.808791 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b0097954-30aa-4b8f-8211-b213524f5929 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:09.809225 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b0097954-30aa-4b8f-8211-b213524f5929 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:09.829088 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-62c337e4-59ed-4268-a590-e24cce7f3269 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:09.836366 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-62c337e4-59ed-4268-a590-e24cce7f3269 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726" status: 200 len: 1245 microversion: 2.1 time: 0.081440 Jun 14 18:30:09.836940 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 178/380] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:09 2022] GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:09.938576 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-b0097954-30aa-4b8f-8211-b213524f5929 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:09.946200 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-b0097954-30aa-4b8f-8211-b213524f5929 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1358 microversion: 2.1 time: 0.149956 Jun 14 18:30:09.946823 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 203/381] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:09 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:10.071076 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-eaec427b-e4c5-4eae-b284-537e5a0706d9 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:10.071756 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-eaec427b-e4c5-4eae-b284-537e5a0706d9 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:10.077898 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-eaec427b-e4c5-4eae-b284-537e5a0706d9 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:10.078347 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-eaec427b-e4c5-4eae-b284-537e5a0706d9 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:10.079147 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-eaec427b-e4c5-4eae-b284-537e5a0706d9 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:10.079581 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-eaec427b-e4c5-4eae-b284-537e5a0706d9 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:10.139610 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-eaec427b-e4c5-4eae-b284-537e5a0706d9 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:10.147472 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-eaec427b-e4c5-4eae-b284-537e5a0706d9 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1139 microversion: 2.1 time: 0.080341 Jun 14 18:30:10.151888 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 179/382] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:10 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1139 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:10.677472 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-9abe0e3d-2ede-418a-a118-e875229015c4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:10.678082 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-9abe0e3d-2ede-418a-a118-e875229015c4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:10.685085 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9abe0e3d-2ede-418a-a118-e875229015c4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:10.685610 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9abe0e3d-2ede-418a-a118-e875229015c4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:10.686379 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9abe0e3d-2ede-418a-a118-e875229015c4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:10.686809 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9abe0e3d-2ede-418a-a118-e875229015c4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:10.853253 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-8990a9ff-5966-4a66-b9ed-9335be382712 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:10.854106 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-8990a9ff-5966-4a66-b9ed-9335be382712 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:10.863722 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8990a9ff-5966-4a66-b9ed-9335be382712 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:10.864490 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8990a9ff-5966-4a66-b9ed-9335be382712 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:10.865434 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8990a9ff-5966-4a66-b9ed-9335be382712 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:10.865910 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8990a9ff-5966-4a66-b9ed-9335be382712 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:10.941491 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-8990a9ff-5966-4a66-b9ed-9335be382712 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:10.957956 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-8990a9ff-5966-4a66-b9ed-9335be382712 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726" status: 200 len: 1245 microversion: 2.1 time: 0.108005 Jun 14 18:30:10.959527 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 180/383] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:10 2022] GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 => generated 1245 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:30:10.969297 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-12bc313d-5d59-495a-b023-cf3be5fbc742 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:10.970026 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-12bc313d-5d59-495a-b023-cf3be5fbc742 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:10.974855 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-9abe0e3d-2ede-418a-a118-e875229015c4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:10.980455 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-12bc313d-5d59-495a-b023-cf3be5fbc742 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:10.981063 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-12bc313d-5d59-495a-b023-cf3be5fbc742 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:10.982464 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-12bc313d-5d59-495a-b023-cf3be5fbc742 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:10.982464 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-12bc313d-5d59-495a-b023-cf3be5fbc742 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:10.988421 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-9abe0e3d-2ede-418a-a118-e875229015c4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:10.992045 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-9abe0e3d-2ede-418a-a118-e875229015c4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:10.993681 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-9abe0e3d-2ede-418a-a118-e875229015c4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1751 microversion: 2.20 time: 0.320132 Jun 14 18:30:11.006643 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell1:SELECT=100 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:30:11.006767 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 204/384] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:30:10 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1751 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:30:11.125401 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-12bc313d-5d59-495a-b023-cf3be5fbc742 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:11.133077 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-12bc313d-5d59-495a-b023-cf3be5fbc742 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1358 microversion: 2.1 time: 0.171841 Jun 14 18:30:11.133900 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 181/385] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:10 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:11.171720 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-af719e30-12b3-41d5-9c74-5f4ef8a38ae7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:11.172460 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-af719e30-12b3-41d5-9c74-5f4ef8a38ae7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:11.178760 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-af719e30-12b3-41d5-9c74-5f4ef8a38ae7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:11.179225 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-af719e30-12b3-41d5-9c74-5f4ef8a38ae7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:11.179980 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-af719e30-12b3-41d5-9c74-5f4ef8a38ae7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:11.180433 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-af719e30-12b3-41d5-9c74-5f4ef8a38ae7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:11.253227 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-af719e30-12b3-41d5-9c74-5f4ef8a38ae7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:11.265204 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-af719e30-12b3-41d5-9c74-5f4ef8a38ae7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1139 microversion: 2.1 time: 0.097621 Jun 14 18:30:11.274543 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 205/386] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:11 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1139 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:11.978741 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-67d302fd-d474-453f-92d0-b885d89ebce6 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:11.980031 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-67d302fd-d474-453f-92d0-b885d89ebce6 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:11.986853 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-67d302fd-d474-453f-92d0-b885d89ebce6 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:11.993087 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-67d302fd-d474-453f-92d0-b885d89ebce6 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:11.993087 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-67d302fd-d474-453f-92d0-b885d89ebce6 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:11.993087 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-67d302fd-d474-453f-92d0-b885d89ebce6 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:12.012738 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-9d29d998-5265-459e-a877-39c7172cf9af tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:12.013348 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-9d29d998-5265-459e-a877-39c7172cf9af tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:12.020277 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9d29d998-5265-459e-a877-39c7172cf9af tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:12.020767 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9d29d998-5265-459e-a877-39c7172cf9af tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:12.021574 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9d29d998-5265-459e-a877-39c7172cf9af tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:12.022013 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9d29d998-5265-459e-a877-39c7172cf9af tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:12.054331 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-67d302fd-d474-453f-92d0-b885d89ebce6 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:12.063491 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-67d302fd-d474-453f-92d0-b885d89ebce6 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726" status: 200 len: 1237 microversion: 2.1 time: 0.092084 Jun 14 18:30:12.064069 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 182/387] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:11 2022] GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 => generated 1237 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:12.153695 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-00851121-273b-41bb-9923-79eea25de30f tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:12.154623 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-00851121-273b-41bb-9923-79eea25de30f tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:12.161081 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-00851121-273b-41bb-9923-79eea25de30f tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:12.161571 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-00851121-273b-41bb-9923-79eea25de30f tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:12.162360 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-00851121-273b-41bb-9923-79eea25de30f tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:12.162797 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-00851121-273b-41bb-9923-79eea25de30f tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:12.166180 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-9d29d998-5265-459e-a877-39c7172cf9af tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:12.176200 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-9d29d998-5265-459e-a877-39c7172cf9af tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:12.179148 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-9d29d998-5265-459e-a877-39c7172cf9af tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:12.180098 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-9d29d998-5265-459e-a877-39c7172cf9af tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1753 microversion: 2.20 time: 0.171611 Jun 14 18:30:12.180519 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 206/388] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:30:12 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:30:12.291416 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-e72b1ef2-7236-4a88-80dc-5a39770de79f tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:12.292222 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-e72b1ef2-7236-4a88-80dc-5a39770de79f tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:12.294432 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell0:SELECT=2 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:30:12.295178 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-00851121-273b-41bb-9923-79eea25de30f tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:12.299364 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e72b1ef2-7236-4a88-80dc-5a39770de79f tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:12.299884 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e72b1ef2-7236-4a88-80dc-5a39770de79f tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:12.300747 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e72b1ef2-7236-4a88-80dc-5a39770de79f tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:12.301171 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e72b1ef2-7236-4a88-80dc-5a39770de79f tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:12.302597 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-00851121-273b-41bb-9923-79eea25de30f tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1358 microversion: 2.1 time: 0.155756 Jun 14 18:30:12.303164 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 183/389] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:12 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:30:12.366584 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-e72b1ef2-7236-4a88-80dc-5a39770de79f tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:12.374420 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-e72b1ef2-7236-4a88-80dc-5a39770de79f tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1131 microversion: 2.1 time: 0.087242 Jun 14 18:30:12.374988 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 207/390] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:12 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1131 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:30:13.085094 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-95b099ef-8e09-4777-8bf9-b234b3ed0594 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:13.086499 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-95b099ef-8e09-4777-8bf9-b234b3ed0594 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:13.106451 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-95b099ef-8e09-4777-8bf9-b234b3ed0594 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:13.108558 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-95b099ef-8e09-4777-8bf9-b234b3ed0594 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:13.113039 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-95b099ef-8e09-4777-8bf9-b234b3ed0594 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:13.116274 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-95b099ef-8e09-4777-8bf9-b234b3ed0594 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:13.200634 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell0:SELECT=16 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:30:13.211923 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-211594b5-87a5-4ddf-9cdb-549f1e0cf0b5 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:13.212939 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-211594b5-87a5-4ddf-9cdb-549f1e0cf0b5 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:13.230872 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-211594b5-87a5-4ddf-9cdb-549f1e0cf0b5 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:13.231759 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-211594b5-87a5-4ddf-9cdb-549f1e0cf0b5 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:13.232961 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-211594b5-87a5-4ddf-9cdb-549f1e0cf0b5 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:13.233606 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-211594b5-87a5-4ddf-9cdb-549f1e0cf0b5 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:13.247334 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-95b099ef-8e09-4777-8bf9-b234b3ed0594 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:13.261868 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-95b099ef-8e09-4777-8bf9-b234b3ed0594 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726" status: 200 len: 1237 microversion: 2.1 time: 0.182687 Jun 14 18:30:13.263119 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 184/391] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:13 2022] GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 => generated 1237 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:13.333288 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-414a3ec7-62cc-48bc-b157-7f150e1234a0 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:13.333288 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-414a3ec7-62cc-48bc-b157-7f150e1234a0 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:13.333288 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-414a3ec7-62cc-48bc-b157-7f150e1234a0 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:13.333288 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-414a3ec7-62cc-48bc-b157-7f150e1234a0 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:13.334269 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-414a3ec7-62cc-48bc-b157-7f150e1234a0 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:13.334269 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-414a3ec7-62cc-48bc-b157-7f150e1234a0 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:13.490572 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-414a3ec7-62cc-48bc-b157-7f150e1234a0 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:13.499622 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-414a3ec7-62cc-48bc-b157-7f150e1234a0 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1358 microversion: 2.1 time: 0.183160 Jun 14 18:30:13.500313 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 185/392] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:13 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:30:13.515101 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-211594b5-87a5-4ddf-9cdb-549f1e0cf0b5 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:13.515246 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-9772cf78-a09a-4219-b2d6-86be2e161215 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:13.515920 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-9772cf78-a09a-4219-b2d6-86be2e161215 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:13.522393 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9772cf78-a09a-4219-b2d6-86be2e161215 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:13.522631 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-211594b5-87a5-4ddf-9cdb-549f1e0cf0b5 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:13.523303 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9772cf78-a09a-4219-b2d6-86be2e161215 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:13.523982 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-211594b5-87a5-4ddf-9cdb-549f1e0cf0b5 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:13.524296 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9772cf78-a09a-4219-b2d6-86be2e161215 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:13.524966 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9772cf78-a09a-4219-b2d6-86be2e161215 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:13.526254 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-211594b5-87a5-4ddf-9cdb-549f1e0cf0b5 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1753 microversion: 2.20 time: 0.330519 Jun 14 18:30:13.537626 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 208/393] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:30:13 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1753 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:30:13.598051 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-9772cf78-a09a-4219-b2d6-86be2e161215 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:13.606486 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-9772cf78-a09a-4219-b2d6-86be2e161215 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1187 microversion: 2.1 time: 0.095912 Jun 14 18:30:13.607115 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 186/394] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:13 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1187 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:14.280054 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-035e2ca6-0cf4-4c9b-ba05-0d2462afcc94 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:14.280705 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-035e2ca6-0cf4-4c9b-ba05-0d2462afcc94 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:14.287564 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-035e2ca6-0cf4-4c9b-ba05-0d2462afcc94 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:14.288031 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-035e2ca6-0cf4-4c9b-ba05-0d2462afcc94 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:14.288817 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-035e2ca6-0cf4-4c9b-ba05-0d2462afcc94 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:14.289802 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-035e2ca6-0cf4-4c9b-ba05-0d2462afcc94 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:14.363695 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-035e2ca6-0cf4-4c9b-ba05-0d2462afcc94 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:14.365913 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell1:SELECT=100 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:30:14.372673 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-035e2ca6-0cf4-4c9b-ba05-0d2462afcc94 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726" status: 200 len: 1293 microversion: 2.1 time: 0.096784 Jun 14 18:30:14.373253 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 209/395] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:14 2022] GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 => generated 1293 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:14.517337 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-ec406fae-8b39-41e9-8a74-8b1d8608cf77 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:14.518040 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-ec406fae-8b39-41e9-8a74-8b1d8608cf77 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:14.524830 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ec406fae-8b39-41e9-8a74-8b1d8608cf77 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:14.525288 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ec406fae-8b39-41e9-8a74-8b1d8608cf77 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:14.526106 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ec406fae-8b39-41e9-8a74-8b1d8608cf77 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:14.526546 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ec406fae-8b39-41e9-8a74-8b1d8608cf77 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:14.552799 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-5fac9064-4d69-4ba1-8d52-0bb868c1d06e tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:14.553637 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-5fac9064-4d69-4ba1-8d52-0bb868c1d06e tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:14.561210 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5fac9064-4d69-4ba1-8d52-0bb868c1d06e tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:14.562106 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5fac9064-4d69-4ba1-8d52-0bb868c1d06e tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:14.563970 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5fac9064-4d69-4ba1-8d52-0bb868c1d06e tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:14.564803 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5fac9064-4d69-4ba1-8d52-0bb868c1d06e tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:14.693763 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-ec406fae-8b39-41e9-8a74-8b1d8608cf77 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:14.707119 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-ec406fae-8b39-41e9-8a74-8b1d8608cf77 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1358 microversion: 2.1 time: 0.193461 Jun 14 18:30:14.708627 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 187/396] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:14 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:14.721862 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-e541bd53-b77f-472f-85d3-4f0f3642680b tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:14.722484 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-e541bd53-b77f-472f-85d3-4f0f3642680b tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:14.729528 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e541bd53-b77f-472f-85d3-4f0f3642680b tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:14.730261 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e541bd53-b77f-472f-85d3-4f0f3642680b tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:14.730588 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e541bd53-b77f-472f-85d3-4f0f3642680b tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:14.731032 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e541bd53-b77f-472f-85d3-4f0f3642680b tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:14.785410 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-5fac9064-4d69-4ba1-8d52-0bb868c1d06e tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:14.797637 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-5fac9064-4d69-4ba1-8d52-0bb868c1d06e tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:14.799305 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-5fac9064-4d69-4ba1-8d52-0bb868c1d06e tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:14.800786 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-5fac9064-4d69-4ba1-8d52-0bb868c1d06e tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1809 microversion: 2.20 time: 0.260570 Jun 14 18:30:14.801419 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 210/397] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:30:14 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1809 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:30:14.812642 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-e541bd53-b77f-472f-85d3-4f0f3642680b tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:14.820516 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-e541bd53-b77f-472f-85d3-4f0f3642680b tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1205 microversion: 2.1 time: 0.102567 Jun 14 18:30:14.821121 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 188/398] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:14 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1205 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:15.390595 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-d58f8143-212c-466d-ac25-a45d1eabb0f5 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:15.392076 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-d58f8143-212c-466d-ac25-a45d1eabb0f5 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:15.403042 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d58f8143-212c-466d-ac25-a45d1eabb0f5 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:15.403640 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d58f8143-212c-466d-ac25-a45d1eabb0f5 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:15.404623 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d58f8143-212c-466d-ac25-a45d1eabb0f5 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:15.405397 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d58f8143-212c-466d-ac25-a45d1eabb0f5 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:15.731201 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-d58f8143-212c-466d-ac25-a45d1eabb0f5 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:15.737917 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-cee42885-4ce1-4acd-9c83-938b65451669 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:15.743255 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-cee42885-4ce1-4acd-9c83-938b65451669 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:15.757792 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-d58f8143-212c-466d-ac25-a45d1eabb0f5 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726" status: 200 len: 1299 microversion: 2.1 time: 0.367591 Jun 14 18:30:15.759245 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 211/399] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:15 2022] GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 => generated 1299 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:15.822239 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-cee42885-4ce1-4acd-9c83-938b65451669 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:15.823730 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-cee42885-4ce1-4acd-9c83-938b65451669 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:15.825213 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-cee42885-4ce1-4acd-9c83-938b65451669 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:15.826091 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-cee42885-4ce1-4acd-9c83-938b65451669 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:15.826370 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-8a93b8f6-195c-4286-aca8-347a983e24ed tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:15.827610 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-8a93b8f6-195c-4286-aca8-347a983e24ed tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:15.843836 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8a93b8f6-195c-4286-aca8-347a983e24ed tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:15.844681 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8a93b8f6-195c-4286-aca8-347a983e24ed tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:15.848004 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8a93b8f6-195c-4286-aca8-347a983e24ed tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:15.848954 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8a93b8f6-195c-4286-aca8-347a983e24ed tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:16.046547 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-cee42885-4ce1-4acd-9c83-938b65451669 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:16.055490 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-cee42885-4ce1-4acd-9c83-938b65451669 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1358 microversion: 2.1 time: 0.333177 Jun 14 18:30:16.056093 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 189/400] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:15 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1358 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:16.067436 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-3e530e15-dd94-4915-b701-0eb215ea31ea tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:16.068901 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-3e530e15-dd94-4915-b701-0eb215ea31ea tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:16.079610 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3e530e15-dd94-4915-b701-0eb215ea31ea tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:16.080075 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3e530e15-dd94-4915-b701-0eb215ea31ea tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:16.081081 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3e530e15-dd94-4915-b701-0eb215ea31ea tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:16.081753 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3e530e15-dd94-4915-b701-0eb215ea31ea tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:16.205391 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-8a93b8f6-195c-4286-aca8-347a983e24ed tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:16.220589 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-8a93b8f6-195c-4286-aca8-347a983e24ed tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:16.222571 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-8a93b8f6-195c-4286-aca8-347a983e24ed tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:16.223977 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-8a93b8f6-195c-4286-aca8-347a983e24ed tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1809 microversion: 2.20 time: 0.407517 Jun 14 18:30:16.224735 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 212/401] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:30:15 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1809 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:30:16.295980 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-3e530e15-dd94-4915-b701-0eb215ea31ea tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:16.306302 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-3e530e15-dd94-4915-b701-0eb215ea31ea tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1272 microversion: 2.1 time: 0.247110 Jun 14 18:30:16.308487 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 190/402] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:16 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1272 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:16.725244 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-f761e212-c401-4387-8c0a-bf5cc16a5c21 req-17c46263-087c-4e44-ada2-5dc9787f27dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "023acd67-717e-45ef-abd2-936d81bbbccd", "name": "network-vif-plugged", "status": "completed", "tag": "9530bd2f-adfe-4346-b9ff-e6d39d227b3c"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:30:16.758215 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-f761e212-c401-4387-8c0a-bf5cc16a5c21 req-17c46263-087c-4e44-ada2-5dc9787f27dc service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:16.762041 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-f761e212-c401-4387-8c0a-bf5cc16a5c21 req-17c46263-087c-4e44-ada2-5dc9787f27dc service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:16.789107 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-f761e212-c401-4387-8c0a-bf5cc16a5c21 req-17c46263-087c-4e44-ada2-5dc9787f27dc service nova] Creating event network-vif-plugged:9530bd2f-adfe-4346-b9ff-e6d39d227b3c for instance 023acd67-717e-45ef-abd2-936d81bbbccd on hv-cinder-84456 Jun 14 18:30:16.794635 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-9093a11f-717b-4e2d-b32d-711798aa4308 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:16.795419 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-9093a11f-717b-4e2d-b32d-711798aa4308 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:16.798261 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-f761e212-c401-4387-8c0a-bf5cc16a5c21 req-17c46263-087c-4e44-ada2-5dc9787f27dc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081994 Jun 14 18:30:16.799562 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 213/403] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:30:16.813604 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9093a11f-717b-4e2d-b32d-711798aa4308 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:16.814839 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9093a11f-717b-4e2d-b32d-711798aa4308 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:16.816100 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9093a11f-717b-4e2d-b32d-711798aa4308 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:16.817310 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9093a11f-717b-4e2d-b32d-711798aa4308 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:17.033404 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-9093a11f-717b-4e2d-b32d-711798aa4308 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:17.047538 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-9093a11f-717b-4e2d-b32d-711798aa4308 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726" status: 200 len: 1299 microversion: 2.1 time: 0.262394 Jun 14 18:30:17.062812 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 191/404] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:16 2022] GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 => generated 1299 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:17.078055 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-ab914b24-35d4-4294-9105-19e1319c042b tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:17.079367 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-ab914b24-35d4-4294-9105-19e1319c042b tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:17.107055 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ab914b24-35d4-4294-9105-19e1319c042b tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:17.107623 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ab914b24-35d4-4294-9105-19e1319c042b tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:17.108761 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ab914b24-35d4-4294-9105-19e1319c042b tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:17.112805 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ab914b24-35d4-4294-9105-19e1319c042b tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:17.243807 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-c4878d8f-3608-4708-b62e-65b5831ec4b1 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:17.244864 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-c4878d8f-3608-4708-b62e-65b5831ec4b1 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:17.250652 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:30:17.260806 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c4878d8f-3608-4708-b62e-65b5831ec4b1 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:17.263077 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c4878d8f-3608-4708-b62e-65b5831ec4b1 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:17.265030 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c4878d8f-3608-4708-b62e-65b5831ec4b1 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:17.266415 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c4878d8f-3608-4708-b62e-65b5831ec4b1 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:17.440296 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-ab914b24-35d4-4294-9105-19e1319c042b tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:17.448429 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-ab914b24-35d4-4294-9105-19e1319c042b tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1358 microversion: 2.1 time: 0.377113 Jun 14 18:30:17.463795 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 214/405] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:17 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1358 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:17.475776 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-a05a2dc6-d487-4f7f-be69-5a8460fc73f7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:17.477064 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-a05a2dc6-d487-4f7f-be69-5a8460fc73f7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:17.490835 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a05a2dc6-d487-4f7f-be69-5a8460fc73f7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:17.492184 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a05a2dc6-d487-4f7f-be69-5a8460fc73f7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:17.495021 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a05a2dc6-d487-4f7f-be69-5a8460fc73f7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:17.495912 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a05a2dc6-d487-4f7f-be69-5a8460fc73f7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:17.497331 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-c4878d8f-3608-4708-b62e-65b5831ec4b1 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:17.523123 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-c4878d8f-3608-4708-b62e-65b5831ec4b1 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:17.531388 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-c4878d8f-3608-4708-b62e-65b5831ec4b1 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:17.537535 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-c4878d8f-3608-4708-b62e-65b5831ec4b1 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1809 microversion: 2.20 time: 0.297025 Jun 14 18:30:17.541825 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 192/406] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:30:17 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1809 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:30:17.868100 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-a05a2dc6-d487-4f7f-be69-5a8460fc73f7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:17.877568 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-a05a2dc6-d487-4f7f-be69-5a8460fc73f7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1260 microversion: 2.1 time: 0.410687 Jun 14 18:30:17.881650 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 215/407] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:17 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1260 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:18.067509 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-d560b87d-d004-4bb5-9ed2-c4e90725d813 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:18.074787 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-d560b87d-d004-4bb5-9ed2-c4e90725d813 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:18.095801 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d560b87d-d004-4bb5-9ed2-c4e90725d813 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:18.097117 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d560b87d-d004-4bb5-9ed2-c4e90725d813 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:18.098299 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d560b87d-d004-4bb5-9ed2-c4e90725d813 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:18.099195 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d560b87d-d004-4bb5-9ed2-c4e90725d813 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:18.468731 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-351fabc8-1ec9-43b1-9a59-47924e6a5a25 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:18.470264 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-351fabc8-1ec9-43b1-9a59-47924e6a5a25 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:18.496724 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-351fabc8-1ec9-43b1-9a59-47924e6a5a25 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:18.498639 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-351fabc8-1ec9-43b1-9a59-47924e6a5a25 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:18.505909 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-351fabc8-1ec9-43b1-9a59-47924e6a5a25 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:18.508683 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-351fabc8-1ec9-43b1-9a59-47924e6a5a25 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:18.671674 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-d560b87d-d004-4bb5-9ed2-c4e90725d813 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:18.699842 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-d560b87d-d004-4bb5-9ed2-c4e90725d813 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726" status: 200 len: 1367 microversion: 2.1 time: 0.623942 Jun 14 18:30:18.707016 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 193/408] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:18 2022] GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 => generated 1367 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:18.724356 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-5a6c21b0-672a-46b1-b957-32e89d5c86a8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:18.734557 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-5a6c21b0-672a-46b1-b957-32e89d5c86a8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:18.741395 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5a6c21b0-672a-46b1-b957-32e89d5c86a8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:18.742658 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5a6c21b0-672a-46b1-b957-32e89d5c86a8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:18.743622 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5a6c21b0-672a-46b1-b957-32e89d5c86a8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:18.746099 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5a6c21b0-672a-46b1-b957-32e89d5c86a8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:19.089856 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-5a6c21b0-672a-46b1-b957-32e89d5c86a8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:19.100685 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-5a6c21b0-672a-46b1-b957-32e89d5c86a8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:19.105174 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-5a6c21b0-672a-46b1-b957-32e89d5c86a8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:19.112294 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-5a6c21b0-672a-46b1-b957-32e89d5c86a8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1809 microversion: 2.20 time: 0.400354 Jun 14 18:30:19.116879 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 194/409] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:30:18 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1809 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:30:19.124345 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-6c647ed8-135e-4fea-be21-2ea4f7d77da2 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:19.125306 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-6c647ed8-135e-4fea-be21-2ea4f7d77da2 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:19.141009 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6c647ed8-135e-4fea-be21-2ea4f7d77da2 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:19.141822 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6c647ed8-135e-4fea-be21-2ea4f7d77da2 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:19.143126 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6c647ed8-135e-4fea-be21-2ea4f7d77da2 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:19.143786 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6c647ed8-135e-4fea-be21-2ea4f7d77da2 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:19.297549 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-351fabc8-1ec9-43b1-9a59-47924e6a5a25 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:19.309852 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-351fabc8-1ec9-43b1-9a59-47924e6a5a25 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1358 microversion: 2.1 time: 0.847628 Jun 14 18:30:19.310437 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 216/410] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:18 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1358 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:19.425737 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-6c647ed8-135e-4fea-be21-2ea4f7d77da2 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:19.443007 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-776e38c7-556a-4739-aa0f-270c72c1f1f3 req-807e2e89-4c34-4578-8eac-6c2e54b8e94d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "750a5111-2788-46b6-aa18-57f7c1019d64", "tag": "4fa1bac8-6b6d-4a62-afca-3aed68487621"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:30:19.444056 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-6c647ed8-135e-4fea-be21-2ea4f7d77da2 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1260 microversion: 2.1 time: 0.321240 Jun 14 18:30:19.445213 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 195/411] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:19 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1260 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:19.483060 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-776e38c7-556a-4739-aa0f-270c72c1f1f3 req-807e2e89-4c34-4578-8eac-6c2e54b8e94d service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:19.483807 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-776e38c7-556a-4739-aa0f-270c72c1f1f3 req-807e2e89-4c34-4578-8eac-6c2e54b8e94d service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:19.537193 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-776e38c7-556a-4739-aa0f-270c72c1f1f3 req-807e2e89-4c34-4578-8eac-6c2e54b8e94d service nova] Creating event network-changed:4fa1bac8-6b6d-4a62-afca-3aed68487621 for instance 750a5111-2788-46b6-aa18-57f7c1019d64 on hv-cinder-84456 Jun 14 18:30:19.558183 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-776e38c7-556a-4739-aa0f-270c72c1f1f3 req-807e2e89-4c34-4578-8eac-6c2e54b8e94d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122198 Jun 14 18:30:19.562940 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 217/412] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:30:19.723894 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-b81f1ddd-dcab-4b5e-a481-c97a965eb639 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:19.727273 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-b81f1ddd-dcab-4b5e-a481-c97a965eb639 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:19.753921 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b81f1ddd-dcab-4b5e-a481-c97a965eb639 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:19.756021 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b81f1ddd-dcab-4b5e-a481-c97a965eb639 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:19.760744 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b81f1ddd-dcab-4b5e-a481-c97a965eb639 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:19.764115 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b81f1ddd-dcab-4b5e-a481-c97a965eb639 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:20.097728 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-b81f1ddd-dcab-4b5e-a481-c97a965eb639 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:20.111278 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-b81f1ddd-dcab-4b5e-a481-c97a965eb639 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726" status: 200 len: 1367 microversion: 2.1 time: 0.397879 Jun 14 18:30:20.112419 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 196/413] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:19 2022] GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 => generated 1367 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:20.134044 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-5c04671c-2ee3-4a7b-ae25-dcddd101c582 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:20.134819 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-5c04671c-2ee3-4a7b-ae25-dcddd101c582 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:20.172924 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5c04671c-2ee3-4a7b-ae25-dcddd101c582 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:20.188054 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5c04671c-2ee3-4a7b-ae25-dcddd101c582 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:20.188054 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5c04671c-2ee3-4a7b-ae25-dcddd101c582 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:20.188054 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5c04671c-2ee3-4a7b-ae25-dcddd101c582 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:20.339307 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-ea54e9a5-5a94-44fe-92da-2eeb22a5935e tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:20.340026 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-ea54e9a5-5a94-44fe-92da-2eeb22a5935e tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:20.353179 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ea54e9a5-5a94-44fe-92da-2eeb22a5935e tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:20.353881 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ea54e9a5-5a94-44fe-92da-2eeb22a5935e tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:20.354818 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ea54e9a5-5a94-44fe-92da-2eeb22a5935e tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:20.355266 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ea54e9a5-5a94-44fe-92da-2eeb22a5935e tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:20.665322 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-5c04671c-2ee3-4a7b-ae25-dcddd101c582 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:20.702373 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-ea54e9a5-5a94-44fe-92da-2eeb22a5935e tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:20.706839 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-5c04671c-2ee3-4a7b-ae25-dcddd101c582 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:20.709391 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell1:SELECT=100 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:30:20.712345 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-5c04671c-2ee3-4a7b-ae25-dcddd101c582 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:20.713081 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-ea54e9a5-5a94-44fe-92da-2eeb22a5935e tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1358 microversion: 2.1 time: 0.378448 Jun 14 18:30:20.714252 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 197/414] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:20 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1358 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:20.719219 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-434a4d61-714a-42b2-83ef-0ab04d606010 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:20.719991 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-434a4d61-714a-42b2-83ef-0ab04d606010 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:20.734292 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-5c04671c-2ee3-4a7b-ae25-dcddd101c582 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1809 microversion: 2.20 time: 0.602374 Jun 14 18:30:20.740099 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 218/415] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:30:20 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1809 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:30:20.754918 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-434a4d61-714a-42b2-83ef-0ab04d606010 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:20.754918 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-434a4d61-714a-42b2-83ef-0ab04d606010 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:20.754918 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-434a4d61-714a-42b2-83ef-0ab04d606010 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:20.754918 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-434a4d61-714a-42b2-83ef-0ab04d606010 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:21.080488 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-434a4d61-714a-42b2-83ef-0ab04d606010 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:21.101073 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-434a4d61-714a-42b2-83ef-0ab04d606010 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1260 microversion: 2.1 time: 0.382960 Jun 14 18:30:21.121715 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 198/416] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:20 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1260 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:21.140920 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-b206a3b7-0404-44c7-ad1b-134814421d86 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:21.141567 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-b206a3b7-0404-44c7-ad1b-134814421d86 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:21.158485 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b206a3b7-0404-44c7-ad1b-134814421d86 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:21.159037 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b206a3b7-0404-44c7-ad1b-134814421d86 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:21.159968 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b206a3b7-0404-44c7-ad1b-134814421d86 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:21.160414 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b206a3b7-0404-44c7-ad1b-134814421d86 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:21.340815 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-b206a3b7-0404-44c7-ad1b-134814421d86 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:21.348858 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-b206a3b7-0404-44c7-ad1b-134814421d86 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726" status: 200 len: 1367 microversion: 2.1 time: 0.213204 Jun 14 18:30:21.349714 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 219/417] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:21 2022] GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:21.595756 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-de4586d2-509f-4fe2-8f7f-1887e1038ed8 req-ad82428f-3b93-4866-9ddb-9b6734a4f00c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1bbd826-8155-4a11-bba3-9a4b3172b726", "tag": "94648b79-8eac-456c-9ef4-94a9d6d3e060"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:30:21.609493 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-de4586d2-509f-4fe2-8f7f-1887e1038ed8 req-ad82428f-3b93-4866-9ddb-9b6734a4f00c service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:21.609493 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-de4586d2-509f-4fe2-8f7f-1887e1038ed8 req-ad82428f-3b93-4866-9ddb-9b6734a4f00c service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:21.617469 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-de4586d2-509f-4fe2-8f7f-1887e1038ed8 req-ad82428f-3b93-4866-9ddb-9b6734a4f00c service nova] Creating event network-changed:94648b79-8eac-456c-9ef4-94a9d6d3e060 for instance f1bbd826-8155-4a11-bba3-9a4b3172b726 on hv-cinder-84456 Jun 14 18:30:21.625914 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-de4586d2-509f-4fe2-8f7f-1887e1038ed8 req-ad82428f-3b93-4866-9ddb-9b6734a4f00c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034127 Jun 14 18:30:21.627421 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 199/418] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:30:21.738374 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-88c08c78-eb23-444a-90af-2aa4f1e4e184 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:21.739005 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-88c08c78-eb23-444a-90af-2aa4f1e4e184 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:21.746794 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-88c08c78-eb23-444a-90af-2aa4f1e4e184 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:21.747490 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-88c08c78-eb23-444a-90af-2aa4f1e4e184 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:21.748691 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-88c08c78-eb23-444a-90af-2aa4f1e4e184 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:21.749201 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-88c08c78-eb23-444a-90af-2aa4f1e4e184 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:21.786236 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-0774196d-2f90-497a-911e-fec504983782 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:21.787001 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-0774196d-2f90-497a-911e-fec504983782 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:21.796365 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0774196d-2f90-497a-911e-fec504983782 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:21.798328 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0774196d-2f90-497a-911e-fec504983782 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:21.798328 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0774196d-2f90-497a-911e-fec504983782 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:21.798328 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0774196d-2f90-497a-911e-fec504983782 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:21.959281 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-88c08c78-eb23-444a-90af-2aa4f1e4e184 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:21.969664 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-88c08c78-eb23-444a-90af-2aa4f1e4e184 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1548 microversion: 2.1 time: 0.235400 Jun 14 18:30:21.970667 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 220/419] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:21 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1548 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:21.990614 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-0774196d-2f90-497a-911e-fec504983782 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:21.997340 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-a844e757-e6f1-40a7-baea-707a1957ac58 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:21.998408 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-a844e757-e6f1-40a7-baea-707a1957ac58 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:22.000613 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-0774196d-2f90-497a-911e-fec504983782 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:22.002809 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-0774196d-2f90-497a-911e-fec504983782 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:22.004936 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-0774196d-2f90-497a-911e-fec504983782 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1809 microversion: 2.20 time: 0.224781 Jun 14 18:30:22.021115 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 200/420] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:30:21 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1809 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:30:22.021624 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a844e757-e6f1-40a7-baea-707a1957ac58 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:22.022451 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a844e757-e6f1-40a7-baea-707a1957ac58 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:22.023747 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a844e757-e6f1-40a7-baea-707a1957ac58 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:22.024652 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a844e757-e6f1-40a7-baea-707a1957ac58 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:22.127806 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-fff32ffa-9a97-47d2-b8c0-2633606c85bd tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:22.127806 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-fff32ffa-9a97-47d2-b8c0-2633606c85bd tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:22.137223 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-fff32ffa-9a97-47d2-b8c0-2633606c85bd tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:22.137801 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-fff32ffa-9a97-47d2-b8c0-2633606c85bd tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:22.138605 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-fff32ffa-9a97-47d2-b8c0-2633606c85bd tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:22.139905 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-fff32ffa-9a97-47d2-b8c0-2633606c85bd tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:22.217935 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-a844e757-e6f1-40a7-baea-707a1957ac58 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:22.226569 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-a844e757-e6f1-40a7-baea-707a1957ac58 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1548 microversion: 2.1 time: 0.241174 Jun 14 18:30:22.227415 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 221/421] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:21 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1548 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:30:22.244585 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-f18ee223-9a43-4726-a156-a19a4d7d2291 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:22.249645 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-f18ee223-9a43-4726-a156-a19a4d7d2291 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:22.251194 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-f18ee223-9a43-4726-a156-a19a4d7d2291 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Searching by: {'deleted': False, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba'} {{(pid=118624) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 14 18:30:22.264906 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f18ee223-9a43-4726-a156-a19a4d7d2291 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:22.265653 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f18ee223-9a43-4726-a156-a19a4d7d2291 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:22.266607 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f18ee223-9a43-4726-a156-a19a4d7d2291 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:22.267182 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f18ee223-9a43-4726-a156-a19a4d7d2291 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:22.375079 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-fff32ffa-9a97-47d2-b8c0-2633606c85bd tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:22.383808 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-fff32ffa-9a97-47d2-b8c0-2633606c85bd tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1260 microversion: 2.1 time: 0.270323 Jun 14 18:30:22.385900 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.multi_cell_list [None req-f18ee223-9a43-4726-a156-a19a4d7d2291 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118624) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 14 18:30:22.394941 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 201/422] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:22 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1260 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:22.400873 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-d2484aa3-ec87-4009-8086-632bb061d825 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:22.402099 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-d2484aa3-ec87-4009-8086-632bb061d825 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:22.408606 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d2484aa3-ec87-4009-8086-632bb061d825 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:22.409131 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d2484aa3-ec87-4009-8086-632bb061d825 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:22.410047 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d2484aa3-ec87-4009-8086-632bb061d825 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:22.410733 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d2484aa3-ec87-4009-8086-632bb061d825 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:22.513971 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-f18ee223-9a43-4726-a156-a19a4d7d2291 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.274375 Jun 14 18:30:22.516308 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 222/423] 10.222.0.78 () {58 vars in 1124 bytes} [Tue Jun 14 18:30:22 2022] GET /compute/v2.1/servers => generated 343 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:30:22.536752 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-dd063d9f-2ad8-432a-a2ca-12b8e5e75999 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:22.545771 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-dd063d9f-2ad8-432a-a2ca-12b8e5e75999 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:22.555806 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-dd063d9f-2ad8-432a-a2ca-12b8e5e75999 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:22.557545 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-dd063d9f-2ad8-432a-a2ca-12b8e5e75999 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:22.558331 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-dd063d9f-2ad8-432a-a2ca-12b8e5e75999 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:22.558914 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-dd063d9f-2ad8-432a-a2ca-12b8e5e75999 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:22.580372 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-d2484aa3-ec87-4009-8086-632bb061d825 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:22.588862 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-d2484aa3-ec87-4009-8086-632bb061d825 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726" status: 200 len: 1367 microversion: 2.1 time: 0.192361 Jun 14 18:30:22.590121 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 202/424] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:22 2022] GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:22.735939 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-dd063d9f-2ad8-432a-a2ca-12b8e5e75999 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:22.748546 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-dd063d9f-2ad8-432a-a2ca-12b8e5e75999 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1548 microversion: 2.1 time: 0.223157 Jun 14 18:30:22.756462 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 223/425] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:22 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1548 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:23.024666 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-c7491a12-87cc-4738-ba4e-cddb4db6ebca tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:23.026136 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-c7491a12-87cc-4738-ba4e-cddb4db6ebca tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:23.032883 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c7491a12-87cc-4738-ba4e-cddb4db6ebca tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:23.046186 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c7491a12-87cc-4738-ba4e-cddb4db6ebca tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:23.047047 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c7491a12-87cc-4738-ba4e-cddb4db6ebca tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:23.047633 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c7491a12-87cc-4738-ba4e-cddb4db6ebca tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:23.232281 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-c7491a12-87cc-4738-ba4e-cddb4db6ebca tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:23.242817 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-c7491a12-87cc-4738-ba4e-cddb4db6ebca tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:23.244523 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-c7491a12-87cc-4738-ba4e-cddb4db6ebca tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:23.245897 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-c7491a12-87cc-4738-ba4e-cddb4db6ebca tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1809 microversion: 2.20 time: 0.225301 Jun 14 18:30:23.247004 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 203/426] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:30:23 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1809 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:30:23.404211 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-608c806e-a7af-41ed-94bb-216e911da375 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:23.405654 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-608c806e-a7af-41ed-94bb-216e911da375 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:23.414398 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-608c806e-a7af-41ed-94bb-216e911da375 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:23.414840 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-608c806e-a7af-41ed-94bb-216e911da375 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:23.415899 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-608c806e-a7af-41ed-94bb-216e911da375 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:23.416390 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-608c806e-a7af-41ed-94bb-216e911da375 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:23.604379 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-608c806e-a7af-41ed-94bb-216e911da375 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:23.606019 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-322ce15b-ca95-4140-b580-f329c3b1634b tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:23.606666 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-322ce15b-ca95-4140-b580-f329c3b1634b tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:23.617803 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-608c806e-a7af-41ed-94bb-216e911da375 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1260 microversion: 2.1 time: 0.214636 Jun 14 18:30:23.618325 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 224/427] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:23 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1260 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:23.619060 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-322ce15b-ca95-4140-b580-f329c3b1634b tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:23.619912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-322ce15b-ca95-4140-b580-f329c3b1634b tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:23.621182 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-322ce15b-ca95-4140-b580-f329c3b1634b tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:23.621760 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-322ce15b-ca95-4140-b580-f329c3b1634b tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:23.791423 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-322ce15b-ca95-4140-b580-f329c3b1634b tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:23.805661 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-322ce15b-ca95-4140-b580-f329c3b1634b tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726" status: 200 len: 1367 microversion: 2.1 time: 0.203989 Jun 14 18:30:23.809353 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 204/428] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:23 2022] GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:30:24.264407 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-714ba57b-f588-49ff-9ed5-c1e58189085d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:24.264992 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-714ba57b-f588-49ff-9ed5-c1e58189085d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:24.281179 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-714ba57b-f588-49ff-9ed5-c1e58189085d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:24.281467 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-714ba57b-f588-49ff-9ed5-c1e58189085d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:24.282414 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-714ba57b-f588-49ff-9ed5-c1e58189085d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:24.282725 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-714ba57b-f588-49ff-9ed5-c1e58189085d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:24.432835 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-714ba57b-f588-49ff-9ed5-c1e58189085d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:24.441864 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-714ba57b-f588-49ff-9ed5-c1e58189085d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:24.443455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-714ba57b-f588-49ff-9ed5-c1e58189085d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:24.444722 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-714ba57b-f588-49ff-9ed5-c1e58189085d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1809 microversion: 2.20 time: 0.184332 Jun 14 18:30:24.445310 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 225/429] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:30:24 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:30:24.636289 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-3bccf53e-89a7-48ce-85ee-c92a8f62fad3 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:24.637941 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-3bccf53e-89a7-48ce-85ee-c92a8f62fad3 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:24.647095 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3bccf53e-89a7-48ce-85ee-c92a8f62fad3 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:24.648024 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3bccf53e-89a7-48ce-85ee-c92a8f62fad3 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:24.649078 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3bccf53e-89a7-48ce-85ee-c92a8f62fad3 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:24.649548 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3bccf53e-89a7-48ce-85ee-c92a8f62fad3 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:24.830404 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-831b1356-4821-4266-9ffa-c33c1b55daf9 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:24.831487 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-831b1356-4821-4266-9ffa-c33c1b55daf9 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:24.836037 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-3bccf53e-89a7-48ce-85ee-c92a8f62fad3 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:24.845108 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-3bccf53e-89a7-48ce-85ee-c92a8f62fad3 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1260 microversion: 2.1 time: 0.212714 Jun 14 18:30:24.846094 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 205/430] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:24 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1260 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:24.858147 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-831b1356-4821-4266-9ffa-c33c1b55daf9 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:24.860450 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-831b1356-4821-4266-9ffa-c33c1b55daf9 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:24.860450 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-831b1356-4821-4266-9ffa-c33c1b55daf9 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:24.860450 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-831b1356-4821-4266-9ffa-c33c1b55daf9 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:24.863719 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-e95a958f-e99e-48ea-991b-fe96dddb1bd5 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0610748b-27e4-4a36-abec-0fbe7bd14439"}} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:30:24.865107 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-e95a958f-e99e-48ea-991b-fe96dddb1bd5 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:24.872482 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e95a958f-e99e-48ea-991b-fe96dddb1bd5 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:24.873205 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e95a958f-e99e-48ea-991b-fe96dddb1bd5 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:24.874369 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e95a958f-e99e-48ea-991b-fe96dddb1bd5 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:24.875975 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e95a958f-e99e-48ea-991b-fe96dddb1bd5 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:25.041834 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-831b1356-4821-4266-9ffa-c33c1b55daf9 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:25.050075 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-831b1356-4821-4266-9ffa-c33c1b55daf9 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726" status: 200 len: 1367 microversion: 2.1 time: 0.225575 Jun 14 18:30:25.053620 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 226/431] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:24 2022] GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:25.464362 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-c453fd26-6546-4b8a-80f5-4c3efe1c62df tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:25.465087 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-c453fd26-6546-4b8a-80f5-4c3efe1c62df tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:25.472709 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c453fd26-6546-4b8a-80f5-4c3efe1c62df tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:25.473164 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c453fd26-6546-4b8a-80f5-4c3efe1c62df tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:25.473969 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c453fd26-6546-4b8a-80f5-4c3efe1c62df tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:25.474400 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c453fd26-6546-4b8a-80f5-4c3efe1c62df tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:25.491463 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell1:SELECT=100 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:30:25.632140 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-c453fd26-6546-4b8a-80f5-4c3efe1c62df tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:25.647741 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-c453fd26-6546-4b8a-80f5-4c3efe1c62df tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:25.649282 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-c453fd26-6546-4b8a-80f5-4c3efe1c62df tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:25.650547 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-c453fd26-6546-4b8a-80f5-4c3efe1c62df tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1809 microversion: 2.20 time: 0.190281 Jun 14 18:30:25.651097 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 227/432] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:30:25 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:30:25.865282 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-67b144c5-0c14-4662-a23b-27a5a31ee7b7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:25.866252 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-67b144c5-0c14-4662-a23b-27a5a31ee7b7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:25.876640 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-67b144c5-0c14-4662-a23b-27a5a31ee7b7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:25.877093 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-67b144c5-0c14-4662-a23b-27a5a31ee7b7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:25.877913 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-67b144c5-0c14-4662-a23b-27a5a31ee7b7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:25.878354 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-67b144c5-0c14-4662-a23b-27a5a31ee7b7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:26.054143 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-67b144c5-0c14-4662-a23b-27a5a31ee7b7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:26.062823 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-67b144c5-0c14-4662-a23b-27a5a31ee7b7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1260 microversion: 2.1 time: 0.203944 Jun 14 18:30:26.063775 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 228/433] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:25 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1260 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:26.068643 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-e656c96f-7f3d-4dd7-9c91-544c08e29550 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:26.069246 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-e656c96f-7f3d-4dd7-9c91-544c08e29550 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:26.076351 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e656c96f-7f3d-4dd7-9c91-544c08e29550 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:26.077058 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e656c96f-7f3d-4dd7-9c91-544c08e29550 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:26.078081 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e656c96f-7f3d-4dd7-9c91-544c08e29550 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:26.078680 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e656c96f-7f3d-4dd7-9c91-544c08e29550 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:26.272959 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-e656c96f-7f3d-4dd7-9c91-544c08e29550 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:26.282940 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-e656c96f-7f3d-4dd7-9c91-544c08e29550 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726" status: 200 len: 1367 microversion: 2.1 time: 0.217884 Jun 14 18:30:26.293531 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 229/434] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:26 2022] GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:30:26.669381 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-ea1fe443-8bec-4668-bb2d-bb0806a5eeb9 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:26.670934 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-ea1fe443-8bec-4668-bb2d-bb0806a5eeb9 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:26.683401 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ea1fe443-8bec-4668-bb2d-bb0806a5eeb9 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:26.684230 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ea1fe443-8bec-4668-bb2d-bb0806a5eeb9 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:26.685081 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ea1fe443-8bec-4668-bb2d-bb0806a5eeb9 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:26.685592 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ea1fe443-8bec-4668-bb2d-bb0806a5eeb9 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:26.854515 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-ea1fe443-8bec-4668-bb2d-bb0806a5eeb9 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:26.879328 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-ea1fe443-8bec-4668-bb2d-bb0806a5eeb9 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:26.881394 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-ea1fe443-8bec-4668-bb2d-bb0806a5eeb9 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:26.889319 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-ea1fe443-8bec-4668-bb2d-bb0806a5eeb9 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1809 microversion: 2.20 time: 0.220009 Jun 14 18:30:26.901502 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 230/435] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:30:26 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1809 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:30:27.081825 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-5487dbe7-214e-4b61-a2f8-d9249319d447 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:27.082676 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-5487dbe7-214e-4b61-a2f8-d9249319d447 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:27.090708 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5487dbe7-214e-4b61-a2f8-d9249319d447 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:27.093245 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5487dbe7-214e-4b61-a2f8-d9249319d447 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:27.093245 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5487dbe7-214e-4b61-a2f8-d9249319d447 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:27.093245 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5487dbe7-214e-4b61-a2f8-d9249319d447 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:27.252264 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-5487dbe7-214e-4b61-a2f8-d9249319d447 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:27.261326 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-5487dbe7-214e-4b61-a2f8-d9249319d447 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1260 microversion: 2.1 time: 0.183589 Jun 14 18:30:27.261962 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 231/436] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:27 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:30:27.305290 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-d9bdf01f-5305-4a41-9fcb-b0e2a17ff729 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:27.306018 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-d9bdf01f-5305-4a41-9fcb-b0e2a17ff729 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:27.313004 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d9bdf01f-5305-4a41-9fcb-b0e2a17ff729 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:27.313684 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d9bdf01f-5305-4a41-9fcb-b0e2a17ff729 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:27.314613 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d9bdf01f-5305-4a41-9fcb-b0e2a17ff729 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:27.315150 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d9bdf01f-5305-4a41-9fcb-b0e2a17ff729 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:27.448572 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-d9bdf01f-5305-4a41-9fcb-b0e2a17ff729 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:27.456469 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-d9bdf01f-5305-4a41-9fcb-b0e2a17ff729 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726" status: 200 len: 1367 microversion: 2.1 time: 0.155017 Jun 14 18:30:27.457051 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 232/437] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:27 2022] GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:30:27.862004 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-ca7f5d33-6b67-472b-9473-7117ddd38e61 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:27.862573 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-ca7f5d33-6b67-472b-9473-7117ddd38e61 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:27.868693 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ca7f5d33-6b67-472b-9473-7117ddd38e61 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:27.869133 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ca7f5d33-6b67-472b-9473-7117ddd38e61 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:27.869907 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ca7f5d33-6b67-472b-9473-7117ddd38e61 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:27.870336 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ca7f5d33-6b67-472b-9473-7117ddd38e61 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:27.999194 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.objects.instance [None req-ca7f5d33-6b67-472b-9473-7117ddd38e61 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lazy-loading 'services' on Instance uuid 90a63d77-87d7-4616-af3d-fe6cb12e93fe {{(pid=118624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:30:28.304862 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-ca7f5d33-6b67-472b-9473-7117ddd38e61 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "DELETE /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe/os-volume_attachments/cb06fd21-9bdf-4055-804f-1ffb6c070bbe" status: 202 len: 0 microversion: 2.1 time: 0.446829 Jun 14 18:30:28.305486 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 233/438] 10.222.0.78 () {58 vars in 1415 bytes} [Tue Jun 14 18:30:27 2022] DELETE /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe/os-volume_attachments/cb06fd21-9bdf-4055-804f-1ffb6c070bbe => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 14 18:30:28.311015 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-4a9e6179-0660-4c5a-a53e-a22a752c4bf5 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:28.312980 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-4a9e6179-0660-4c5a-a53e-a22a752c4bf5 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:28.325524 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4a9e6179-0660-4c5a-a53e-a22a752c4bf5 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:28.325524 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4a9e6179-0660-4c5a-a53e-a22a752c4bf5 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:28.326076 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4a9e6179-0660-4c5a-a53e-a22a752c4bf5 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:28.327625 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4a9e6179-0660-4c5a-a53e-a22a752c4bf5 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:28.725291 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-4a9e6179-0660-4c5a-a53e-a22a752c4bf5 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:28.735398 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-4a9e6179-0660-4c5a-a53e-a22a752c4bf5 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:28.736914 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-4a9e6179-0660-4c5a-a53e-a22a752c4bf5 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:28.738262 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-4a9e6179-0660-4c5a-a53e-a22a752c4bf5 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1809 microversion: 2.20 time: 0.431530 Jun 14 18:30:28.738837 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 234/439] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:30:28 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1809 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:30:28.743587 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-e8e07add-2c17-4136-8300-db310eae1d9d tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:28.744190 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-e8e07add-2c17-4136-8300-db310eae1d9d tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:28.751574 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e8e07add-2c17-4136-8300-db310eae1d9d tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:28.752025 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e8e07add-2c17-4136-8300-db310eae1d9d tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:28.752796 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e8e07add-2c17-4136-8300-db310eae1d9d tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:28.753233 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e8e07add-2c17-4136-8300-db310eae1d9d tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:28.992412 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-e8e07add-2c17-4136-8300-db310eae1d9d tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:29.000422 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-e8e07add-2c17-4136-8300-db310eae1d9d tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1260 microversion: 2.1 time: 0.260328 Jun 14 18:30:29.001103 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 235/440] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:28 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1260 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:29.005804 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-b8925707-ec11-47da-bacb-9a39a3425de3 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:29.008134 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-b8925707-ec11-47da-bacb-9a39a3425de3 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:29.013763 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b8925707-ec11-47da-bacb-9a39a3425de3 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:29.014222 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b8925707-ec11-47da-bacb-9a39a3425de3 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:29.015338 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b8925707-ec11-47da-bacb-9a39a3425de3 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:29.015765 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b8925707-ec11-47da-bacb-9a39a3425de3 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:29.036576 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-e95a958f-e99e-48ea-991b-fe96dddb1bd5 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "POST /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.177136 Jun 14 18:30:29.037522 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 206/441] 10.222.0.78 () {60 vars in 1322 bytes} [Tue Jun 14 18:30:24 2022] POST /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd/os-volume_attachments => generated 194 bytes in 4179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:30:29.429406 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-b8925707-ec11-47da-bacb-9a39a3425de3 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:29.437485 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-b8925707-ec11-47da-bacb-9a39a3425de3 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726" status: 200 len: 1367 microversion: 2.1 time: 0.435193 Jun 14 18:30:29.438214 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 236/442] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:29 2022] GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 => generated 1367 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:29.757877 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-85f353fe-f4f8-44fb-b190-32dd89e9eb7b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:29.758648 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-85f353fe-f4f8-44fb-b190-32dd89e9eb7b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:29.765184 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-85f353fe-f4f8-44fb-b190-32dd89e9eb7b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:29.766317 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-85f353fe-f4f8-44fb-b190-32dd89e9eb7b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:29.767213 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-85f353fe-f4f8-44fb-b190-32dd89e9eb7b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:29.767648 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-85f353fe-f4f8-44fb-b190-32dd89e9eb7b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:29.922398 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-85f353fe-f4f8-44fb-b190-32dd89e9eb7b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:29.931365 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-85f353fe-f4f8-44fb-b190-32dd89e9eb7b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:29.933215 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-85f353fe-f4f8-44fb-b190-32dd89e9eb7b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:29.934575 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-85f353fe-f4f8-44fb-b190-32dd89e9eb7b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1809 microversion: 2.20 time: 0.181691 Jun 14 18:30:29.935136 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 207/443] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:30:29 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:30:30.020546 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-eb54e699-befa-4d59-9413-abc02c195d92 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:30.020546 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-eb54e699-befa-4d59-9413-abc02c195d92 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:30.025250 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-eb54e699-befa-4d59-9413-abc02c195d92 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:30.025784 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-eb54e699-befa-4d59-9413-abc02c195d92 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:30.026539 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-eb54e699-befa-4d59-9413-abc02c195d92 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:30.026980 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-eb54e699-befa-4d59-9413-abc02c195d92 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:30.168292 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-eb54e699-befa-4d59-9413-abc02c195d92 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:30.177072 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-eb54e699-befa-4d59-9413-abc02c195d92 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1260 microversion: 2.1 time: 0.162901 Jun 14 18:30:30.177662 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 237/444] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:30 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:30.454531 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-42c565e7-62f8-4719-a153-42880b649690 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:30.455174 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-42c565e7-62f8-4719-a153-42880b649690 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:30.461218 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-42c565e7-62f8-4719-a153-42880b649690 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:30.461713 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-42c565e7-62f8-4719-a153-42880b649690 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:30.462483 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-42c565e7-62f8-4719-a153-42880b649690 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:30.462922 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-42c565e7-62f8-4719-a153-42880b649690 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:30.499297 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-2ce253c7-49c1-47d0-8a54-7df5b91c7fac tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:30:30.505966 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2ce253c7-49c1-47d0-8a54-7df5b91c7fac tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:30.506495 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2ce253c7-49c1-47d0-8a54-7df5b91c7fac tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:30.528987 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-2ce253c7-49c1-47d0-8a54-7df5b91c7fac tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Going to try to stop instance {{(pid=118624) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 14 18:30:30.596622 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-42c565e7-62f8-4719-a153-42880b649690 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:30.604200 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-42c565e7-62f8-4719-a153-42880b649690 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726" status: 200 len: 1367 microversion: 2.1 time: 0.153846 Jun 14 18:30:30.604759 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 208/445] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:30 2022] GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:30.733960 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-2ce253c7-49c1-47d0-8a54-7df5b91c7fac tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "POST /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe/action" status: 202 len: 0 microversion: 2.1 time: 0.238211 Jun 14 18:30:30.734989 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 238/446] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Jun 14 18:30:30 2022] POST /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 14 18:30:30.743449 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-b7a549f5-0750-4e21-973b-84d6a7788711 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:30.744424 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-b7a549f5-0750-4e21-973b-84d6a7788711 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:30.750974 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b7a549f5-0750-4e21-973b-84d6a7788711 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:30.751722 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b7a549f5-0750-4e21-973b-84d6a7788711 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:30.752730 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b7a549f5-0750-4e21-973b-84d6a7788711 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:30.753265 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b7a549f5-0750-4e21-973b-84d6a7788711 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:30.889335 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-b7a549f5-0750-4e21-973b-84d6a7788711 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:30.897983 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-b7a549f5-0750-4e21-973b-84d6a7788711 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1678 microversion: 2.1 time: 0.158509 Jun 14 18:30:30.898554 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 209/447] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:30 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:30.959920 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-4c599f7d-0aec-4ca9-93f1-1ea379ab2259 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:30.960667 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-4c599f7d-0aec-4ca9-93f1-1ea379ab2259 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:30.966862 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4c599f7d-0aec-4ca9-93f1-1ea379ab2259 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:30.967349 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4c599f7d-0aec-4ca9-93f1-1ea379ab2259 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:30.968114 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4c599f7d-0aec-4ca9-93f1-1ea379ab2259 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:30.969482 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4c599f7d-0aec-4ca9-93f1-1ea379ab2259 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:31.194361 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-017d7228-a48f-4713-a9fc-611c7d176d1b tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:31.195085 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-017d7228-a48f-4713-a9fc-611c7d176d1b tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:31.202293 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-017d7228-a48f-4713-a9fc-611c7d176d1b tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:31.202877 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-017d7228-a48f-4713-a9fc-611c7d176d1b tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:31.204620 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-017d7228-a48f-4713-a9fc-611c7d176d1b tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:31.205211 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-017d7228-a48f-4713-a9fc-611c7d176d1b tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:31.258661 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-4c599f7d-0aec-4ca9-93f1-1ea379ab2259 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:31.269900 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-4c599f7d-0aec-4ca9-93f1-1ea379ab2259 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:31.271574 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-4c599f7d-0aec-4ca9-93f1-1ea379ab2259 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:31.272995 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-4c599f7d-0aec-4ca9-93f1-1ea379ab2259 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1809 microversion: 2.20 time: 0.317564 Jun 14 18:30:31.273585 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 239/448] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:30:30 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1809 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:30:31.362103 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-017d7228-a48f-4713-a9fc-611c7d176d1b tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:31.369594 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-017d7228-a48f-4713-a9fc-611c7d176d1b tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1260 microversion: 2.1 time: 0.179046 Jun 14 18:30:31.370159 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 210/449] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:31 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:30:31.621848 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-0605503c-af91-4f46-b63d-2213fd6ff7ad tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:31.622486 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-0605503c-af91-4f46-b63d-2213fd6ff7ad tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:31.636255 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-0605503c-af91-4f46-b63d-2213fd6ff7ad tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:31.636698 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-0605503c-af91-4f46-b63d-2213fd6ff7ad tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:31.637478 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-0605503c-af91-4f46-b63d-2213fd6ff7ad tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:31.637916 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-0605503c-af91-4f46-b63d-2213fd6ff7ad tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:31.801871 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-0605503c-af91-4f46-b63d-2213fd6ff7ad tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:31.809150 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-0605503c-af91-4f46-b63d-2213fd6ff7ad tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726" status: 200 len: 1367 microversion: 2.1 time: 0.191208 Jun 14 18:30:31.809734 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 240/450] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:31 2022] GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:31.916368 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-bf54d590-4e84-4d69-8468-2a53f716f64f tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:31.916976 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-bf54d590-4e84-4d69-8468-2a53f716f64f tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:31.924208 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-bf54d590-4e84-4d69-8468-2a53f716f64f tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:31.924653 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-bf54d590-4e84-4d69-8468-2a53f716f64f tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:31.925413 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-bf54d590-4e84-4d69-8468-2a53f716f64f tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:31.925893 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-bf54d590-4e84-4d69-8468-2a53f716f64f tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:32.054008 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-bf54d590-4e84-4d69-8468-2a53f716f64f tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:32.061421 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-bf54d590-4e84-4d69-8468-2a53f716f64f tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1678 microversion: 2.1 time: 0.149192 Jun 14 18:30:32.061997 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 211/451] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:31 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:32.292068 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-0fd4e8bf-3d3f-488b-b822-c49c3c228b02 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:32.292665 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-0fd4e8bf-3d3f-488b-b822-c49c3c228b02 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:32.295090 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_api:SELECT=100 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:30:32.300041 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-0fd4e8bf-3d3f-488b-b822-c49c3c228b02 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:32.303752 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-0fd4e8bf-3d3f-488b-b822-c49c3c228b02 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:32.303752 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-0fd4e8bf-3d3f-488b-b822-c49c3c228b02 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:32.303752 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-0fd4e8bf-3d3f-488b-b822-c49c3c228b02 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:32.331079 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell0:SELECT=2 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:30:32.387936 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-7724b4c1-f700-466c-9138-4f69cdf6ae5c tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:32.388695 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-7724b4c1-f700-466c-9138-4f69cdf6ae5c tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:32.397895 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7724b4c1-f700-466c-9138-4f69cdf6ae5c tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:32.397895 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7724b4c1-f700-466c-9138-4f69cdf6ae5c tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:32.397895 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7724b4c1-f700-466c-9138-4f69cdf6ae5c tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:32.398442 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7724b4c1-f700-466c-9138-4f69cdf6ae5c tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:32.478148 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-0fd4e8bf-3d3f-488b-b822-c49c3c228b02 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:32.492416 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-0fd4e8bf-3d3f-488b-b822-c49c3c228b02 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:32.494546 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-0fd4e8bf-3d3f-488b-b822-c49c3c228b02 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:32.495752 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-0fd4e8bf-3d3f-488b-b822-c49c3c228b02 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1809 microversion: 2.20 time: 0.207936 Jun 14 18:30:32.501503 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 241/452] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:30:32 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1809 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:30:32.556337 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-7724b4c1-f700-466c-9138-4f69cdf6ae5c tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:32.566009 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-7724b4c1-f700-466c-9138-4f69cdf6ae5c tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1260 microversion: 2.1 time: 0.181866 Jun 14 18:30:32.569124 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 212/453] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:32 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:30:32.827433 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-32162098-f531-4b67-8d59-aee6fe9c5708 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:32.828184 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-32162098-f531-4b67-8d59-aee6fe9c5708 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:32.834578 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-32162098-f531-4b67-8d59-aee6fe9c5708 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:32.835026 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-32162098-f531-4b67-8d59-aee6fe9c5708 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:32.835947 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-32162098-f531-4b67-8d59-aee6fe9c5708 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:32.836222 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-32162098-f531-4b67-8d59-aee6fe9c5708 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:32.851818 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:30:32.980030 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-32162098-f531-4b67-8d59-aee6fe9c5708 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:32.987563 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-32162098-f531-4b67-8d59-aee6fe9c5708 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726" status: 200 len: 1367 microversion: 2.1 time: 0.163967 Jun 14 18:30:32.988131 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 242/454] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:32 2022] GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:33.087035 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-621bc5c4-f8e8-40a0-8718-be4d19607b3f tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:33.087786 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-621bc5c4-f8e8-40a0-8718-be4d19607b3f tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:33.096246 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-621bc5c4-f8e8-40a0-8718-be4d19607b3f tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:33.096705 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-621bc5c4-f8e8-40a0-8718-be4d19607b3f tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:33.097638 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-621bc5c4-f8e8-40a0-8718-be4d19607b3f tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:33.098311 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-621bc5c4-f8e8-40a0-8718-be4d19607b3f tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:33.235761 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-621bc5c4-f8e8-40a0-8718-be4d19607b3f tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:33.239341 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:30:33.243721 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-621bc5c4-f8e8-40a0-8718-be4d19607b3f tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1678 microversion: 2.1 time: 0.168897 Jun 14 18:30:33.244286 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 213/455] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:33 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:33.518587 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-42f451dd-5f5d-42af-aad7-a03138e58213 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:33.519204 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-42f451dd-5f5d-42af-aad7-a03138e58213 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:33.527440 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-42f451dd-5f5d-42af-aad7-a03138e58213 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:33.527892 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-42f451dd-5f5d-42af-aad7-a03138e58213 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:33.528741 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-42f451dd-5f5d-42af-aad7-a03138e58213 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:33.529176 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-42f451dd-5f5d-42af-aad7-a03138e58213 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:33.584140 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-bee5716c-a40f-4fd2-a000-f5a9cf06e25a tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:33.584752 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-bee5716c-a40f-4fd2-a000-f5a9cf06e25a tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:33.592068 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-bee5716c-a40f-4fd2-a000-f5a9cf06e25a tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:33.592603 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-bee5716c-a40f-4fd2-a000-f5a9cf06e25a tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:33.593503 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-bee5716c-a40f-4fd2-a000-f5a9cf06e25a tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:33.594060 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-bee5716c-a40f-4fd2-a000-f5a9cf06e25a tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:33.666655 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-42f451dd-5f5d-42af-aad7-a03138e58213 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:33.676013 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-42f451dd-5f5d-42af-aad7-a03138e58213 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:33.677590 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-42f451dd-5f5d-42af-aad7-a03138e58213 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:33.678768 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-42f451dd-5f5d-42af-aad7-a03138e58213 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1809 microversion: 2.20 time: 0.164047 Jun 14 18:30:33.679328 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 243/456] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:30:33 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:30:33.729948 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-bee5716c-a40f-4fd2-a000-f5a9cf06e25a tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:33.738177 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-bee5716c-a40f-4fd2-a000-f5a9cf06e25a tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1260 microversion: 2.1 time: 0.158263 Jun 14 18:30:33.738752 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 214/457] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:33 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:30:34.005651 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-86b50cd3-6ddb-4c50-a29c-d0a6ea1a8b40 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:34.006219 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-86b50cd3-6ddb-4c50-a29c-d0a6ea1a8b40 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:34.013644 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-86b50cd3-6ddb-4c50-a29c-d0a6ea1a8b40 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:34.014101 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-86b50cd3-6ddb-4c50-a29c-d0a6ea1a8b40 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:34.014883 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-86b50cd3-6ddb-4c50-a29c-d0a6ea1a8b40 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:34.015428 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-86b50cd3-6ddb-4c50-a29c-d0a6ea1a8b40 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:34.155467 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-86b50cd3-6ddb-4c50-a29c-d0a6ea1a8b40 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:34.166202 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-86b50cd3-6ddb-4c50-a29c-d0a6ea1a8b40 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726" status: 200 len: 1367 microversion: 2.1 time: 0.164381 Jun 14 18:30:34.166770 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 244/458] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:33 2022] GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:34.260942 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-53321b25-ef7f-40eb-837f-0a1bc6e93997 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:34.261429 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-53321b25-ef7f-40eb-837f-0a1bc6e93997 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:34.268526 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-53321b25-ef7f-40eb-837f-0a1bc6e93997 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:34.268978 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-53321b25-ef7f-40eb-837f-0a1bc6e93997 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:34.269770 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-53321b25-ef7f-40eb-837f-0a1bc6e93997 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:34.270209 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-53321b25-ef7f-40eb-837f-0a1bc6e93997 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:34.409156 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-53321b25-ef7f-40eb-837f-0a1bc6e93997 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:34.418785 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-53321b25-ef7f-40eb-837f-0a1bc6e93997 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1678 microversion: 2.1 time: 0.161777 Jun 14 18:30:34.419349 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 215/459] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:34 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:34.698908 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-a35b9739-e32a-4fa0-9f84-1c7cc77635a8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:34.699395 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-a35b9739-e32a-4fa0-9f84-1c7cc77635a8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:34.707329 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a35b9739-e32a-4fa0-9f84-1c7cc77635a8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:34.707791 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a35b9739-e32a-4fa0-9f84-1c7cc77635a8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:34.708761 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a35b9739-e32a-4fa0-9f84-1c7cc77635a8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:34.709202 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a35b9739-e32a-4fa0-9f84-1c7cc77635a8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:34.755933 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-c4fb5133-a7ca-4b51-ac75-6150dd8d2a50 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:34.756559 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-c4fb5133-a7ca-4b51-ac75-6150dd8d2a50 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:34.764788 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c4fb5133-a7ca-4b51-ac75-6150dd8d2a50 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:34.766871 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c4fb5133-a7ca-4b51-ac75-6150dd8d2a50 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:34.767686 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c4fb5133-a7ca-4b51-ac75-6150dd8d2a50 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:34.768288 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c4fb5133-a7ca-4b51-ac75-6150dd8d2a50 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:34.875622 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-a35b9739-e32a-4fa0-9f84-1c7cc77635a8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:34.884706 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-a35b9739-e32a-4fa0-9f84-1c7cc77635a8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:34.886602 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-a35b9739-e32a-4fa0-9f84-1c7cc77635a8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:34.887642 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-a35b9739-e32a-4fa0-9f84-1c7cc77635a8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1809 microversion: 2.20 time: 0.193419 Jun 14 18:30:34.888364 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 245/460] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:30:34 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:30:34.903216 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-448aeda8-b862-475b-9583-3ee91be03380 req-1f560e49-f1ae-4f76-aa49-4c35d6f23df2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1bbd826-8155-4a11-bba3-9a4b3172b726", "name": "network-vif-plugged", "status": "completed", "tag": "94648b79-8eac-456c-9ef4-94a9d6d3e060"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:30:34.913103 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-448aeda8-b862-475b-9583-3ee91be03380 req-1f560e49-f1ae-4f76-aa49-4c35d6f23df2 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:34.913583 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-448aeda8-b862-475b-9583-3ee91be03380 req-1f560e49-f1ae-4f76-aa49-4c35d6f23df2 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:34.926357 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-448aeda8-b862-475b-9583-3ee91be03380 req-1f560e49-f1ae-4f76-aa49-4c35d6f23df2 service nova] Creating event network-vif-plugged:94648b79-8eac-456c-9ef4-94a9d6d3e060 for instance f1bbd826-8155-4a11-bba3-9a4b3172b726 on hv-cinder-84456 Jun 14 18:30:34.931721 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-448aeda8-b862-475b-9583-3ee91be03380 req-1f560e49-f1ae-4f76-aa49-4c35d6f23df2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042129 Jun 14 18:30:34.932935 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 246/461] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:30:34.947620 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-c4fb5133-a7ca-4b51-ac75-6150dd8d2a50 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:34.968055 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-c4fb5133-a7ca-4b51-ac75-6150dd8d2a50 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1260 microversion: 2.1 time: 0.216523 Jun 14 18:30:34.968677 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 216/462] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:34 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1260 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:30:35.185302 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-127960e9-c40b-4257-ad50-db1acf1dceb2 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:35.186044 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-127960e9-c40b-4257-ad50-db1acf1dceb2 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:35.193609 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-127960e9-c40b-4257-ad50-db1acf1dceb2 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:35.194055 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-127960e9-c40b-4257-ad50-db1acf1dceb2 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:35.195080 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-127960e9-c40b-4257-ad50-db1acf1dceb2 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:35.196631 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-127960e9-c40b-4257-ad50-db1acf1dceb2 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:35.415860 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-127960e9-c40b-4257-ad50-db1acf1dceb2 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:35.425270 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-127960e9-c40b-4257-ad50-db1acf1dceb2 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726" status: 200 len: 1367 microversion: 2.1 time: 0.245767 Jun 14 18:30:35.426661 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 247/463] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:35 2022] GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:35.436965 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-2d66b439-5b06-4c04-8f68-8ee4b5d0bfb5 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:35.438566 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-2d66b439-5b06-4c04-8f68-8ee4b5d0bfb5 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:35.446166 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2d66b439-5b06-4c04-8f68-8ee4b5d0bfb5 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:35.446468 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2d66b439-5b06-4c04-8f68-8ee4b5d0bfb5 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:35.447237 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2d66b439-5b06-4c04-8f68-8ee4b5d0bfb5 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:35.447665 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2d66b439-5b06-4c04-8f68-8ee4b5d0bfb5 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:35.585682 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-2d66b439-5b06-4c04-8f68-8ee4b5d0bfb5 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:35.593228 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-2d66b439-5b06-4c04-8f68-8ee4b5d0bfb5 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1678 microversion: 2.1 time: 0.160185 Jun 14 18:30:35.594465 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 217/464] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:35 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:35.906752 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-b6a629da-a5ea-4a3b-8e37-ac1a4f46a0e4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:35.907359 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-b6a629da-a5ea-4a3b-8e37-ac1a4f46a0e4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:35.914164 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b6a629da-a5ea-4a3b-8e37-ac1a4f46a0e4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:35.914638 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b6a629da-a5ea-4a3b-8e37-ac1a4f46a0e4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:35.915398 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b6a629da-a5ea-4a3b-8e37-ac1a4f46a0e4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:35.916076 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b6a629da-a5ea-4a3b-8e37-ac1a4f46a0e4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:35.988443 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-cee3ceaa-c390-42ef-82e7-35ea136887b3 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:35.991704 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-cee3ceaa-c390-42ef-82e7-35ea136887b3 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:35.997933 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-cee3ceaa-c390-42ef-82e7-35ea136887b3 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:35.998478 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-cee3ceaa-c390-42ef-82e7-35ea136887b3 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:35.999439 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-cee3ceaa-c390-42ef-82e7-35ea136887b3 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:36.000805 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-cee3ceaa-c390-42ef-82e7-35ea136887b3 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:36.064840 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-b6a629da-a5ea-4a3b-8e37-ac1a4f46a0e4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:36.075542 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-b6a629da-a5ea-4a3b-8e37-ac1a4f46a0e4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:36.079687 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-b6a629da-a5ea-4a3b-8e37-ac1a4f46a0e4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:36.080975 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-b6a629da-a5ea-4a3b-8e37-ac1a4f46a0e4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1809 microversion: 2.20 time: 0.178216 Jun 14 18:30:36.085093 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 248/465] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:30:35 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:30:36.144176 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-cee3ceaa-c390-42ef-82e7-35ea136887b3 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:36.153874 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-cee3ceaa-c390-42ef-82e7-35ea136887b3 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1260 microversion: 2.1 time: 0.169789 Jun 14 18:30:36.154544 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 218/466] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:35 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:36.443064 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-4b516410-6ba7-46f4-82ef-77d33866c827 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:36.443668 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-4b516410-6ba7-46f4-82ef-77d33866c827 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:36.449907 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4b516410-6ba7-46f4-82ef-77d33866c827 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:36.450350 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4b516410-6ba7-46f4-82ef-77d33866c827 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:36.451196 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4b516410-6ba7-46f4-82ef-77d33866c827 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:36.451584 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4b516410-6ba7-46f4-82ef-77d33866c827 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:36.609149 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-4b516410-6ba7-46f4-82ef-77d33866c827 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:36.616891 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-ec66f22c-7c75-4afe-9dcc-877be9c64785 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:36.617590 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-ec66f22c-7c75-4afe-9dcc-877be9c64785 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:36.617708 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-4b516410-6ba7-46f4-82ef-77d33866c827 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726" status: 200 len: 1367 microversion: 2.1 time: 0.178267 Jun 14 18:30:36.618362 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 249/467] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:36 2022] GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:30:36.627251 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ec66f22c-7c75-4afe-9dcc-877be9c64785 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:36.628580 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ec66f22c-7c75-4afe-9dcc-877be9c64785 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:36.628580 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ec66f22c-7c75-4afe-9dcc-877be9c64785 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:36.628912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ec66f22c-7c75-4afe-9dcc-877be9c64785 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:36.773564 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-ec66f22c-7c75-4afe-9dcc-877be9c64785 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:36.782160 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-ec66f22c-7c75-4afe-9dcc-877be9c64785 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1678 microversion: 2.1 time: 0.169051 Jun 14 18:30:36.782696 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 219/468] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:36 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:36.949271 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-bd7ab704-2838-4d30-9f4a-878157dd0745 req-44d114af-b31d-4dbf-b1a5-da09aa7fc947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2876875b-5dbe-4032-949a-3357292296a2", "name": "network-vif-plugged", "status": "completed", "tag": "ee384335-560e-4f82-a137-0b23b61ff825"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:30:36.959019 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-bd7ab704-2838-4d30-9f4a-878157dd0745 req-44d114af-b31d-4dbf-b1a5-da09aa7fc947 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:36.959464 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-bd7ab704-2838-4d30-9f4a-878157dd0745 req-44d114af-b31d-4dbf-b1a5-da09aa7fc947 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:36.971564 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-bd7ab704-2838-4d30-9f4a-878157dd0745 req-44d114af-b31d-4dbf-b1a5-da09aa7fc947 service nova] Creating event network-vif-plugged:ee384335-560e-4f82-a137-0b23b61ff825 for instance 2876875b-5dbe-4032-949a-3357292296a2 on hv-cinder-84456 Jun 14 18:30:36.976704 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-bd7ab704-2838-4d30-9f4a-878157dd0745 req-44d114af-b31d-4dbf-b1a5-da09aa7fc947 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031159 Jun 14 18:30:36.977297 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 250/469] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:30:37.100215 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-1870a6eb-b7d6-4654-830a-07ba0eacda78 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:37.100834 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-1870a6eb-b7d6-4654-830a-07ba0eacda78 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:37.107289 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1870a6eb-b7d6-4654-830a-07ba0eacda78 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:37.107782 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1870a6eb-b7d6-4654-830a-07ba0eacda78 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:37.108543 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1870a6eb-b7d6-4654-830a-07ba0eacda78 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:37.109758 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1870a6eb-b7d6-4654-830a-07ba0eacda78 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:37.173317 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-24fbb092-b22f-472a-b3fc-399a5b1fdfff tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:37.174066 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-24fbb092-b22f-472a-b3fc-399a5b1fdfff tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:37.180801 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-24fbb092-b22f-472a-b3fc-399a5b1fdfff tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:37.181245 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-24fbb092-b22f-472a-b3fc-399a5b1fdfff tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:37.182067 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-24fbb092-b22f-472a-b3fc-399a5b1fdfff tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:37.182502 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-24fbb092-b22f-472a-b3fc-399a5b1fdfff tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:37.251950 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-1870a6eb-b7d6-4654-830a-07ba0eacda78 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:37.262658 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-1870a6eb-b7d6-4654-830a-07ba0eacda78 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:37.264436 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-1870a6eb-b7d6-4654-830a-07ba0eacda78 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:37.265855 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-1870a6eb-b7d6-4654-830a-07ba0eacda78 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1809 microversion: 2.20 time: 0.169507 Jun 14 18:30:37.266906 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 220/470] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:30:37 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:30:37.325366 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-24fbb092-b22f-472a-b3fc-399a5b1fdfff tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:37.333568 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-24fbb092-b22f-472a-b3fc-399a5b1fdfff tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1260 microversion: 2.1 time: 0.165447 Jun 14 18:30:37.334143 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 251/471] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:37 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:30:37.635778 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-5aaf181d-377b-4e8b-bb11-bcbfca13833f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:37.637107 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-5aaf181d-377b-4e8b-bb11-bcbfca13833f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:37.644143 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5aaf181d-377b-4e8b-bb11-bcbfca13833f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:37.646136 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5aaf181d-377b-4e8b-bb11-bcbfca13833f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:37.646136 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5aaf181d-377b-4e8b-bb11-bcbfca13833f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:37.646136 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5aaf181d-377b-4e8b-bb11-bcbfca13833f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:37.787092 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-5aaf181d-377b-4e8b-bb11-bcbfca13833f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:37.795435 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-5aaf181d-377b-4e8b-bb11-bcbfca13833f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726" status: 200 len: 1367 microversion: 2.1 time: 0.163841 Jun 14 18:30:37.796287 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 221/472] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:37 2022] GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:30:37.804294 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-97304888-f796-4943-8706-c1a4c3008c5c tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:37.804836 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-97304888-f796-4943-8706-c1a4c3008c5c tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:37.810871 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-97304888-f796-4943-8706-c1a4c3008c5c tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:37.811310 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-97304888-f796-4943-8706-c1a4c3008c5c tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:37.812679 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-97304888-f796-4943-8706-c1a4c3008c5c tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:37.813173 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-97304888-f796-4943-8706-c1a4c3008c5c tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:37.963456 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-97304888-f796-4943-8706-c1a4c3008c5c tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:37.972284 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-97304888-f796-4943-8706-c1a4c3008c5c tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1678 microversion: 2.1 time: 0.176160 Jun 14 18:30:37.972858 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 252/473] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:37 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:38.285255 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-380e5928-c023-4be9-af1e-a1ba32eefb10 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:38.285994 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-380e5928-c023-4be9-af1e-a1ba32eefb10 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:38.292571 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-380e5928-c023-4be9-af1e-a1ba32eefb10 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:38.293049 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-380e5928-c023-4be9-af1e-a1ba32eefb10 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:38.293982 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-380e5928-c023-4be9-af1e-a1ba32eefb10 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:38.294424 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-380e5928-c023-4be9-af1e-a1ba32eefb10 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:38.350731 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-d9439cf0-eb99-4038-a28d-d166a7f138cf tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:38.354562 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-d9439cf0-eb99-4038-a28d-d166a7f138cf tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:38.359032 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d9439cf0-eb99-4038-a28d-d166a7f138cf tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:38.359472 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d9439cf0-eb99-4038-a28d-d166a7f138cf tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:38.360317 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d9439cf0-eb99-4038-a28d-d166a7f138cf tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:38.360745 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d9439cf0-eb99-4038-a28d-d166a7f138cf tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:38.436254 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-380e5928-c023-4be9-af1e-a1ba32eefb10 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:38.448449 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-380e5928-c023-4be9-af1e-a1ba32eefb10 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:38.451155 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-380e5928-c023-4be9-af1e-a1ba32eefb10 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:38.463687 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-380e5928-c023-4be9-af1e-a1ba32eefb10 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1809 microversion: 2.20 time: 0.172541 Jun 14 18:30:38.463687 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 222/474] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:30:38 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:30:38.506571 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-d9439cf0-eb99-4038-a28d-d166a7f138cf tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:38.518128 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-d9439cf0-eb99-4038-a28d-d166a7f138cf tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1260 microversion: 2.1 time: 0.169825 Jun 14 18:30:38.526589 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 253/475] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:38 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:30:38.814728 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-9f86ddcd-0073-4b5f-a06e-2c249009f729 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:38.815344 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-9f86ddcd-0073-4b5f-a06e-2c249009f729 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:38.823075 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9f86ddcd-0073-4b5f-a06e-2c249009f729 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:38.823529 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9f86ddcd-0073-4b5f-a06e-2c249009f729 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:38.824706 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9f86ddcd-0073-4b5f-a06e-2c249009f729 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:38.825139 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9f86ddcd-0073-4b5f-a06e-2c249009f729 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:38.973815 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-9f86ddcd-0073-4b5f-a06e-2c249009f729 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:38.981819 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-9f86ddcd-0073-4b5f-a06e-2c249009f729 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726" status: 200 len: 1557 microversion: 2.1 time: 0.172370 Jun 14 18:30:38.982813 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 223/476] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:38 2022] GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 => generated 1557 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:38.989368 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-fc7ebe74-b2bd-42cf-b8fb-1d2b75d80fe8 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:38.990006 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-fc7ebe74-b2bd-42cf-b8fb-1d2b75d80fe8 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:38.997635 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-fc7ebe74-b2bd-42cf-b8fb-1d2b75d80fe8 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:38.998249 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-fc7ebe74-b2bd-42cf-b8fb-1d2b75d80fe8 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:39.000800 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-fc7ebe74-b2bd-42cf-b8fb-1d2b75d80fe8 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:39.003000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-fc7ebe74-b2bd-42cf-b8fb-1d2b75d80fe8 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:39.019033 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-972355e9-ea74-445f-9ea2-516578c09378 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:39.019511 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-972355e9-ea74-445f-9ea2-516578c09378 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:39.028026 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-972355e9-ea74-445f-9ea2-516578c09378 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:39.028477 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-972355e9-ea74-445f-9ea2-516578c09378 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:39.029373 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-972355e9-ea74-445f-9ea2-516578c09378 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:39.029722 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-972355e9-ea74-445f-9ea2-516578c09378 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:39.117913 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-972355e9-ea74-445f-9ea2-516578c09378 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.122382 Jun 14 18:30:39.118505 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 224/477] 10.222.0.78 () {58 vars in 1274 bytes} [Tue Jun 14 18:30:38 2022] GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726/os-interface => generated 285 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:30:39.205591 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-fc7ebe74-b2bd-42cf-b8fb-1d2b75d80fe8 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:39.214432 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-fc7ebe74-b2bd-42cf-b8fb-1d2b75d80fe8 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1678 microversion: 2.1 time: 0.228758 Jun 14 18:30:39.215541 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 254/478] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:38 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1678 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:30:39.476871 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-3895e0ef-17d5-4203-9dd1-1ebe20ddd9e4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:39.477790 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-3895e0ef-17d5-4203-9dd1-1ebe20ddd9e4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:39.486894 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3895e0ef-17d5-4203-9dd1-1ebe20ddd9e4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:39.487473 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3895e0ef-17d5-4203-9dd1-1ebe20ddd9e4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:39.488531 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3895e0ef-17d5-4203-9dd1-1ebe20ddd9e4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:39.488972 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3895e0ef-17d5-4203-9dd1-1ebe20ddd9e4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:39.535812 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-67d4ba61-3e9c-4ec0-96e9-fcfbb8304c29 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:39.536745 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-67d4ba61-3e9c-4ec0-96e9-fcfbb8304c29 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:39.544939 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-67d4ba61-3e9c-4ec0-96e9-fcfbb8304c29 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:39.545504 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-67d4ba61-3e9c-4ec0-96e9-fcfbb8304c29 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:39.546457 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-67d4ba61-3e9c-4ec0-96e9-fcfbb8304c29 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:39.550143 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-67d4ba61-3e9c-4ec0-96e9-fcfbb8304c29 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:39.738101 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-3895e0ef-17d5-4203-9dd1-1ebe20ddd9e4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:39.747703 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-3895e0ef-17d5-4203-9dd1-1ebe20ddd9e4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:39.749689 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-3895e0ef-17d5-4203-9dd1-1ebe20ddd9e4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:39.751048 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-3895e0ef-17d5-4203-9dd1-1ebe20ddd9e4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1809 microversion: 2.20 time: 0.282443 Jun 14 18:30:39.751833 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 225/479] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:30:39 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1809 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:30:39.783992 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-67d4ba61-3e9c-4ec0-96e9-fcfbb8304c29 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:39.793133 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-67d4ba61-3e9c-4ec0-96e9-fcfbb8304c29 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1260 microversion: 2.1 time: 0.262004 Jun 14 18:30:39.794241 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 255/480] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:39 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1260 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:30:40.233640 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-f2516346-9c8e-4246-b646-9439cdc6022c tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:40.234946 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-f2516346-9c8e-4246-b646-9439cdc6022c tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:40.241861 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f2516346-9c8e-4246-b646-9439cdc6022c tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:40.242450 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f2516346-9c8e-4246-b646-9439cdc6022c tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:40.243343 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f2516346-9c8e-4246-b646-9439cdc6022c tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:40.243883 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f2516346-9c8e-4246-b646-9439cdc6022c tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:40.463485 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-f2516346-9c8e-4246-b646-9439cdc6022c tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:40.473305 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-f2516346-9c8e-4246-b646-9439cdc6022c tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1678 microversion: 2.1 time: 0.243505 Jun 14 18:30:40.474236 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 226/481] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:40 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1678 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:40.616977 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-5443ad07-8bbf-4027-8163-140a62facf50 req-cb3b3820-42da-4e8a-913a-75473305fe63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1bbd826-8155-4a11-bba3-9a4b3172b726", "tag": "94648b79-8eac-456c-9ef4-94a9d6d3e060"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:30:40.626330 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-5443ad07-8bbf-4027-8163-140a62facf50 req-cb3b3820-42da-4e8a-913a-75473305fe63 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:40.626866 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-5443ad07-8bbf-4027-8163-140a62facf50 req-cb3b3820-42da-4e8a-913a-75473305fe63 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:40.639085 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-5443ad07-8bbf-4027-8163-140a62facf50 req-cb3b3820-42da-4e8a-913a-75473305fe63 service nova] Creating event network-changed:94648b79-8eac-456c-9ef4-94a9d6d3e060 for instance f1bbd826-8155-4a11-bba3-9a4b3172b726 on hv-cinder-84456 Jun 14 18:30:40.645775 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-5443ad07-8bbf-4027-8163-140a62facf50 req-cb3b3820-42da-4e8a-913a-75473305fe63 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032563 Jun 14 18:30:40.646372 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 256/482] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:30:40.778026 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-651cc0e5-1e5a-4abe-a471-c8e8bb013622 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:40.779386 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-651cc0e5-1e5a-4abe-a471-c8e8bb013622 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:40.793834 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-651cc0e5-1e5a-4abe-a471-c8e8bb013622 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:40.794679 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-651cc0e5-1e5a-4abe-a471-c8e8bb013622 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:40.803179 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-651cc0e5-1e5a-4abe-a471-c8e8bb013622 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:40.808043 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-651cc0e5-1e5a-4abe-a471-c8e8bb013622 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:40.813690 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-f802c78e-1469-4126-92d2-c95072cc8c6c tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:40.813690 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-f802c78e-1469-4126-92d2-c95072cc8c6c tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:40.826543 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f802c78e-1469-4126-92d2-c95072cc8c6c tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:40.827004 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f802c78e-1469-4126-92d2-c95072cc8c6c tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:40.831437 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f802c78e-1469-4126-92d2-c95072cc8c6c tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:40.831907 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f802c78e-1469-4126-92d2-c95072cc8c6c tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:41.044858 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-651cc0e5-1e5a-4abe-a471-c8e8bb013622 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:41.061216 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-651cc0e5-1e5a-4abe-a471-c8e8bb013622 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:41.070912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-651cc0e5-1e5a-4abe-a471-c8e8bb013622 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:41.072197 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-651cc0e5-1e5a-4abe-a471-c8e8bb013622 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1809 microversion: 2.20 time: 0.301098 Jun 14 18:30:41.078789 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 227/483] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:30:40 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1809 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:30:41.082067 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-44c1165d-06d7-40b0-8973-ae296bfa8118 req-e20dc0a8-c82a-4a6c-9305-9f7fac7e6d14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "750a5111-2788-46b6-aa18-57f7c1019d64", "name": "network-vif-plugged", "status": "completed", "tag": "4fa1bac8-6b6d-4a62-afca-3aed68487621"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:30:41.091198 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-44c1165d-06d7-40b0-8973-ae296bfa8118 req-e20dc0a8-c82a-4a6c-9305-9f7fac7e6d14 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:41.094680 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-44c1165d-06d7-40b0-8973-ae296bfa8118 req-e20dc0a8-c82a-4a6c-9305-9f7fac7e6d14 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:41.121005 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-f802c78e-1469-4126-92d2-c95072cc8c6c tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:41.124386 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-44c1165d-06d7-40b0-8973-ae296bfa8118 req-e20dc0a8-c82a-4a6c-9305-9f7fac7e6d14 service nova] Creating event network-vif-plugged:4fa1bac8-6b6d-4a62-afca-3aed68487621 for instance 750a5111-2788-46b6-aa18-57f7c1019d64 on hv-cinder-84456 Jun 14 18:30:41.136304 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-f802c78e-1469-4126-92d2-c95072cc8c6c tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1260 microversion: 2.1 time: 0.329172 Jun 14 18:30:41.136608 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-44c1165d-06d7-40b0-8973-ae296bfa8118 req-e20dc0a8-c82a-4a6c-9305-9f7fac7e6d14 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060861 Jun 14 18:30:41.139713 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 257/484] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:40 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1260 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:30:41.145072 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 228/485] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:30:41.151018 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-41500a8a-721e-4bf3-af5a-1232fcb8eed8 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:41.152912 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-41500a8a-721e-4bf3-af5a-1232fcb8eed8 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:41.172619 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-41500a8a-721e-4bf3-af5a-1232fcb8eed8 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:41.173101 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-41500a8a-721e-4bf3-af5a-1232fcb8eed8 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:41.173955 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-41500a8a-721e-4bf3-af5a-1232fcb8eed8 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:41.179337 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-41500a8a-721e-4bf3-af5a-1232fcb8eed8 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:41.348819 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-41500a8a-721e-4bf3-af5a-1232fcb8eed8 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:41.359411 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-41500a8a-721e-4bf3-af5a-1232fcb8eed8 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1594 microversion: 2.1 time: 0.217067 Jun 14 18:30:41.361906 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 258/486] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:41 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1594 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:41.492023 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-3ff8a803-88ef-4de2-bb56-508afe1ff310 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:41.495774 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-3ff8a803-88ef-4de2-bb56-508afe1ff310 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:41.516334 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3ff8a803-88ef-4de2-bb56-508afe1ff310 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:41.516789 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3ff8a803-88ef-4de2-bb56-508afe1ff310 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:41.520787 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3ff8a803-88ef-4de2-bb56-508afe1ff310 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:41.520787 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3ff8a803-88ef-4de2-bb56-508afe1ff310 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:41.757555 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-3ff8a803-88ef-4de2-bb56-508afe1ff310 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:41.767582 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-3ff8a803-88ef-4de2-bb56-508afe1ff310 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1678 microversion: 2.1 time: 0.280256 Jun 14 18:30:41.768851 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 229/487] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:41 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1678 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:30:42.092288 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-2099adf6-1ff9-4b89-88bf-4cbe5a839f08 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:42.092817 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-2099adf6-1ff9-4b89-88bf-4cbe5a839f08 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:42.100911 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2099adf6-1ff9-4b89-88bf-4cbe5a839f08 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:42.101355 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2099adf6-1ff9-4b89-88bf-4cbe5a839f08 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:42.102182 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2099adf6-1ff9-4b89-88bf-4cbe5a839f08 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:42.102871 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2099adf6-1ff9-4b89-88bf-4cbe5a839f08 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:42.157704 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-eef38a13-46d4-4463-ad9e-869e38dff2b1 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:42.158790 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-eef38a13-46d4-4463-ad9e-869e38dff2b1 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:42.168360 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-eef38a13-46d4-4463-ad9e-869e38dff2b1 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:42.168823 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-eef38a13-46d4-4463-ad9e-869e38dff2b1 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:42.169628 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-eef38a13-46d4-4463-ad9e-869e38dff2b1 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:42.170067 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-eef38a13-46d4-4463-ad9e-869e38dff2b1 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:42.316051 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-2099adf6-1ff9-4b89-88bf-4cbe5a839f08 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:42.325911 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-2099adf6-1ff9-4b89-88bf-4cbe5a839f08 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:42.328077 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-2099adf6-1ff9-4b89-88bf-4cbe5a839f08 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:42.330501 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-2099adf6-1ff9-4b89-88bf-4cbe5a839f08 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1809 microversion: 2.20 time: 0.242118 Jun 14 18:30:42.341734 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 259/488] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:30:42 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1809 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:30:42.349422 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-eef38a13-46d4-4463-ad9e-869e38dff2b1 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:42.357309 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-eef38a13-46d4-4463-ad9e-869e38dff2b1 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1260 microversion: 2.1 time: 0.204397 Jun 14 18:30:42.358122 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 230/489] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:42 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1260 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:30:42.788515 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-b2abf984-618f-4ce7-95f0-f9ffc05ba986 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:42.789304 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-b2abf984-618f-4ce7-95f0-f9ffc05ba986 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:42.799335 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b2abf984-618f-4ce7-95f0-f9ffc05ba986 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:42.800769 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b2abf984-618f-4ce7-95f0-f9ffc05ba986 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:42.801928 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b2abf984-618f-4ce7-95f0-f9ffc05ba986 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:42.802564 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b2abf984-618f-4ce7-95f0-f9ffc05ba986 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:43.348128 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-b2abf984-618f-4ce7-95f0-f9ffc05ba986 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:43.350959 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-c7bdffa1-ba20-44db-923e-cb32a07e8793 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:43.352260 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-c7bdffa1-ba20-44db-923e-cb32a07e8793 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:43.359496 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-b2abf984-618f-4ce7-95f0-f9ffc05ba986 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1678 microversion: 2.1 time: 0.574317 Jun 14 18:30:43.360165 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c7bdffa1-ba20-44db-923e-cb32a07e8793 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:43.360502 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 260/490] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:42 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1678 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:43.370161 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c7bdffa1-ba20-44db-923e-cb32a07e8793 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:43.371075 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c7bdffa1-ba20-44db-923e-cb32a07e8793 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:43.371576 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c7bdffa1-ba20-44db-923e-cb32a07e8793 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:43.377699 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-c01b9524-0220-4834-b0cb-b520d1486633 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:43.378381 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-c01b9524-0220-4834-b0cb-b520d1486633 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:43.384929 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c01b9524-0220-4834-b0cb-b520d1486633 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:43.385877 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c01b9524-0220-4834-b0cb-b520d1486633 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:43.386834 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c01b9524-0220-4834-b0cb-b520d1486633 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:43.387406 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c01b9524-0220-4834-b0cb-b520d1486633 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:43.393427 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell1:SELECT=100 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:30:43.393615 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell1:SELECT=100 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:30:43.541293 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-c7bdffa1-ba20-44db-923e-cb32a07e8793 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:43.550505 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-c7bdffa1-ba20-44db-923e-cb32a07e8793 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:43.552504 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-c7bdffa1-ba20-44db-923e-cb32a07e8793 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:43.554337 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-c7bdffa1-ba20-44db-923e-cb32a07e8793 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1809 microversion: 2.20 time: 0.208655 Jun 14 18:30:43.565392 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 231/491] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:30:43 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1809 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:30:43.620715 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-c01b9524-0220-4834-b0cb-b520d1486633 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:43.629770 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-c01b9524-0220-4834-b0cb-b520d1486633 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1260 microversion: 2.1 time: 0.257380 Jun 14 18:30:43.631727 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 261/492] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:43 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1260 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:30:44.378291 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-a6790da7-80a5-4687-a7fc-54ebf701fb86 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:44.378896 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-a6790da7-80a5-4687-a7fc-54ebf701fb86 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:44.385751 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a6790da7-80a5-4687-a7fc-54ebf701fb86 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:44.386203 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a6790da7-80a5-4687-a7fc-54ebf701fb86 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:44.386981 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a6790da7-80a5-4687-a7fc-54ebf701fb86 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:44.387416 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a6790da7-80a5-4687-a7fc-54ebf701fb86 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:44.530831 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-a6790da7-80a5-4687-a7fc-54ebf701fb86 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:44.538741 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-a6790da7-80a5-4687-a7fc-54ebf701fb86 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1678 microversion: 2.1 time: 0.165215 Jun 14 18:30:44.539372 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 232/493] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:44 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:44.572460 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-6727926d-0420-4709-aab5-106f9031ecb2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:44.573066 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-6727926d-0420-4709-aab5-106f9031ecb2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:44.581540 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6727926d-0420-4709-aab5-106f9031ecb2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:44.581540 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6727926d-0420-4709-aab5-106f9031ecb2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:44.582472 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6727926d-0420-4709-aab5-106f9031ecb2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:44.583108 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6727926d-0420-4709-aab5-106f9031ecb2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:44.652193 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-fa64410d-f315-40a6-97f4-078712f57624 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:44.653119 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-fa64410d-f315-40a6-97f4-078712f57624 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:44.660367 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-fa64410d-f315-40a6-97f4-078712f57624 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:44.660728 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-fa64410d-f315-40a6-97f4-078712f57624 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:44.661770 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-fa64410d-f315-40a6-97f4-078712f57624 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:44.662397 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-fa64410d-f315-40a6-97f4-078712f57624 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:44.792810 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-6727926d-0420-4709-aab5-106f9031ecb2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:44.802307 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-6727926d-0420-4709-aab5-106f9031ecb2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:44.807555 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-6727926d-0420-4709-aab5-106f9031ecb2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:44.807555 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-6727926d-0420-4709-aab5-106f9031ecb2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1809 microversion: 2.20 time: 0.236740 Jun 14 18:30:44.807555 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 262/494] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:30:44 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1809 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:30:44.809878 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-ea5edcc0-81e2-4074-a744-b7ea14f8fa17 req-47fc7577-7cb3-492a-bb4f-ad56bbe8c307 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "023acd67-717e-45ef-abd2-936d81bbbccd", "tag": "9530bd2f-adfe-4346-b9ff-e6d39d227b3c"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:30:44.818591 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-ea5edcc0-81e2-4074-a744-b7ea14f8fa17 req-47fc7577-7cb3-492a-bb4f-ad56bbe8c307 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:44.819028 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-ea5edcc0-81e2-4074-a744-b7ea14f8fa17 req-47fc7577-7cb3-492a-bb4f-ad56bbe8c307 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:44.832320 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-ea5edcc0-81e2-4074-a744-b7ea14f8fa17 req-47fc7577-7cb3-492a-bb4f-ad56bbe8c307 service nova] Creating event network-changed:9530bd2f-adfe-4346-b9ff-e6d39d227b3c for instance 023acd67-717e-45ef-abd2-936d81bbbccd on hv-cinder-84456 Jun 14 18:30:44.838261 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-ea5edcc0-81e2-4074-a744-b7ea14f8fa17 req-47fc7577-7cb3-492a-bb4f-ad56bbe8c307 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031179 Jun 14 18:30:44.839101 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 263/495] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:30:44.847963 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-fa64410d-f315-40a6-97f4-078712f57624 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:44.855729 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-fa64410d-f315-40a6-97f4-078712f57624 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1260 microversion: 2.1 time: 0.207253 Jun 14 18:30:44.856321 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 233/496] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:44 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1260 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:45.559534 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-221af5c4-d9c4-429e-87fc-061837f53a96 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:45.560751 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-221af5c4-d9c4-429e-87fc-061837f53a96 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:45.572222 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-221af5c4-d9c4-429e-87fc-061837f53a96 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:45.573266 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-221af5c4-d9c4-429e-87fc-061837f53a96 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:45.574625 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-221af5c4-d9c4-429e-87fc-061837f53a96 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:45.575554 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-221af5c4-d9c4-429e-87fc-061837f53a96 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:45.738728 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-221af5c4-d9c4-429e-87fc-061837f53a96 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:45.747628 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-221af5c4-d9c4-429e-87fc-061837f53a96 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1678 microversion: 2.1 time: 0.194274 Jun 14 18:30:45.748631 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 264/497] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:45 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1678 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:45.823982 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-759c7681-9618-4bdf-9284-fe1b4a79837f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:45.824717 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-759c7681-9618-4bdf-9284-fe1b4a79837f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:45.832487 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-759c7681-9618-4bdf-9284-fe1b4a79837f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:45.832934 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-759c7681-9618-4bdf-9284-fe1b4a79837f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:45.833755 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-759c7681-9618-4bdf-9284-fe1b4a79837f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:45.834197 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-759c7681-9618-4bdf-9284-fe1b4a79837f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:45.872876 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-4c038ddd-dd90-4919-9117-15ab34db07ab tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:45.873517 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-4c038ddd-dd90-4919-9117-15ab34db07ab tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:45.882047 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4c038ddd-dd90-4919-9117-15ab34db07ab tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:45.882499 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4c038ddd-dd90-4919-9117-15ab34db07ab tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:45.883284 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4c038ddd-dd90-4919-9117-15ab34db07ab tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:45.883908 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4c038ddd-dd90-4919-9117-15ab34db07ab tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:45.984972 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-759c7681-9618-4bdf-9284-fe1b4a79837f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:45.993760 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-759c7681-9618-4bdf-9284-fe1b4a79837f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:45.995261 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-759c7681-9618-4bdf-9284-fe1b4a79837f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:45.996422 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-759c7681-9618-4bdf-9284-fe1b4a79837f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1796 microversion: 2.20 time: 0.176479 Jun 14 18:30:45.997166 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 234/498] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:30:45 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1796 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:30:46.062394 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-4c038ddd-dd90-4919-9117-15ab34db07ab tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:46.071014 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-4c038ddd-dd90-4919-9117-15ab34db07ab tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1445 microversion: 2.1 time: 0.201837 Jun 14 18:30:46.075499 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 265/499] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:45 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1445 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:30:46.089095 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-0e93df05-15ef-4968-9cbf-f2db7c05165a tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:46.089737 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-0e93df05-15ef-4968-9cbf-f2db7c05165a tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:46.096301 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0e93df05-15ef-4968-9cbf-f2db7c05165a tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:46.096793 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0e93df05-15ef-4968-9cbf-f2db7c05165a tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:46.099159 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0e93df05-15ef-4968-9cbf-f2db7c05165a tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:46.099634 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0e93df05-15ef-4968-9cbf-f2db7c05165a tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:46.107256 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-fd5da998-0dd6-4790-81da-7c72001f1ea7 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "402021d3-07bc-4453-9422-1aa4fb65a611"}} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:30:46.107256 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-fd5da998-0dd6-4790-81da-7c72001f1ea7 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:46.112612 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-fd5da998-0dd6-4790-81da-7c72001f1ea7 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:46.113061 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-fd5da998-0dd6-4790-81da-7c72001f1ea7 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:46.113894 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-fd5da998-0dd6-4790-81da-7c72001f1ea7 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:46.114330 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-fd5da998-0dd6-4790-81da-7c72001f1ea7 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:46.246535 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-0e93df05-15ef-4968-9cbf-f2db7c05165a tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:46.255327 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-0e93df05-15ef-4968-9cbf-f2db7c05165a tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1445 microversion: 2.1 time: 0.170274 Jun 14 18:30:46.263461 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 235/500] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:46 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1445 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:46.764953 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-2940c9d8-47c6-4a79-83a2-dbedb3147f1e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:46.765774 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-2940c9d8-47c6-4a79-83a2-dbedb3147f1e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:46.772106 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2940c9d8-47c6-4a79-83a2-dbedb3147f1e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:46.772792 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2940c9d8-47c6-4a79-83a2-dbedb3147f1e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:46.773736 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2940c9d8-47c6-4a79-83a2-dbedb3147f1e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:46.774398 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2940c9d8-47c6-4a79-83a2-dbedb3147f1e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:46.990282 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-2940c9d8-47c6-4a79-83a2-dbedb3147f1e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:46.998937 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-2940c9d8-47c6-4a79-83a2-dbedb3147f1e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1655 microversion: 2.1 time: 0.237772 Jun 14 18:30:47.000104 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 236/501] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:46 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1655 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:30:47.016665 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-17087d90-c84e-4a6c-b868-114b092775aa tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:30:47.023160 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-17087d90-c84e-4a6c-b868-114b092775aa tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:47.023614 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-17087d90-c84e-4a6c-b868-114b092775aa tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:47.049015 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-17087d90-c84e-4a6c-b868-114b092775aa tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Going to try to start instance {{(pid=118623) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 14 18:30:47.090210 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-fd5da998-0dd6-4790-81da-7c72001f1ea7 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "POST /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.989510 Jun 14 18:30:47.091231 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 266/502] 10.222.0.78 () {60 vars in 1322 bytes} [Tue Jun 14 18:30:46 2022] POST /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015/os-volume_attachments => generated 194 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:30:47.297760 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-17087d90-c84e-4a6c-b868-114b092775aa tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "POST /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe/action" status: 202 len: 0 microversion: 2.1 time: 0.285255 Jun 14 18:30:47.298460 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 237/503] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Jun 14 18:30:47 2022] POST /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 14 18:30:47.308066 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-94d0fa38-b23f-41d7-8fa8-0e743b438b31 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:47.308926 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-94d0fa38-b23f-41d7-8fa8-0e743b438b31 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:47.315790 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-94d0fa38-b23f-41d7-8fa8-0e743b438b31 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:47.316397 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-94d0fa38-b23f-41d7-8fa8-0e743b438b31 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:47.317486 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-94d0fa38-b23f-41d7-8fa8-0e743b438b31 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:47.318035 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-94d0fa38-b23f-41d7-8fa8-0e743b438b31 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:47.480953 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-94d0fa38-b23f-41d7-8fa8-0e743b438b31 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:47.488917 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-94d0fa38-b23f-41d7-8fa8-0e743b438b31 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1664 microversion: 2.1 time: 0.185825 Jun 14 18:30:47.489674 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 267/504] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:47 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1664 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:48.076419 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-11c3fcc0-9feb-4c77-b0ad-eead8bba1d86 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2137036214"}} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:30:48.077059 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-11c3fcc0-9feb-4c77-b0ad-eead8bba1d86 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:48.084423 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-11c3fcc0-9feb-4c77-b0ad-eead8bba1d86 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:48.084882 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-11c3fcc0-9feb-4c77-b0ad-eead8bba1d86 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:48.085763 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-11c3fcc0-9feb-4c77-b0ad-eead8bba1d86 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:48.086514 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-11c3fcc0-9feb-4c77-b0ad-eead8bba1d86 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:48.331256 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.network.security_group_api [None req-11c3fcc0-9feb-4c77-b0ad-eead8bba1d86 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Adding security group a043ae42-832d-4072-8ca0-33689f176a66 to port 9530bd2f-adfe-4346-b9ff-e6d39d227b3c Jun 14 18:30:48.506824 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-ca44cf0c-e6df-491b-b802-5f30f7b3c80e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:48.507428 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-ca44cf0c-e6df-491b-b802-5f30f7b3c80e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:48.514124 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ca44cf0c-e6df-491b-b802-5f30f7b3c80e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:48.514576 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ca44cf0c-e6df-491b-b802-5f30f7b3c80e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:48.516046 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ca44cf0c-e6df-491b-b802-5f30f7b3c80e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:48.516487 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ca44cf0c-e6df-491b-b802-5f30f7b3c80e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:48.655543 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-ca44cf0c-e6df-491b-b802-5f30f7b3c80e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:48.666290 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-ca44cf0c-e6df-491b-b802-5f30f7b3c80e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1664 microversion: 2.1 time: 0.163376 Jun 14 18:30:48.666882 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 268/505] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:48 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1664 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:30:48.870425 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-0a736b66-5fc4-48ed-81ec-39f9cd57013d req-d968230d-d609-4ffc-aaaf-b13aca713ade service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "750a5111-2788-46b6-aa18-57f7c1019d64", "tag": "4fa1bac8-6b6d-4a62-afca-3aed68487621"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:30:48.879127 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-0a736b66-5fc4-48ed-81ec-39f9cd57013d req-d968230d-d609-4ffc-aaaf-b13aca713ade service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:48.879574 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-0a736b66-5fc4-48ed-81ec-39f9cd57013d req-d968230d-d609-4ffc-aaaf-b13aca713ade service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:48.890631 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-0a736b66-5fc4-48ed-81ec-39f9cd57013d req-d968230d-d609-4ffc-aaaf-b13aca713ade service nova] Creating event network-changed:4fa1bac8-6b6d-4a62-afca-3aed68487621 for instance 750a5111-2788-46b6-aa18-57f7c1019d64 on hv-cinder-84456 Jun 14 18:30:48.895601 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-0a736b66-5fc4-48ed-81ec-39f9cd57013d req-d968230d-d609-4ffc-aaaf-b13aca713ade service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028778 Jun 14 18:30:48.896400 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 269/506] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:30:48.982875 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-11c3fcc0-9feb-4c77-b0ad-eead8bba1d86 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "POST /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd/action" status: 202 len: 0 microversion: 2.1 time: 0.911213 Jun 14 18:30:48.983473 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 238/507] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Jun 14 18:30:48 2022] POST /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd/action => generated 0 bytes in 913 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:30:48.994120 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-3b46558a-5772-40da-821c-ab52b4cf5736 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:48.995422 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-3b46558a-5772-40da-821c-ab52b4cf5736 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:49.008631 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3b46558a-5772-40da-821c-ab52b4cf5736 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:49.013786 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3b46558a-5772-40da-821c-ab52b4cf5736 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:49.014527 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3b46558a-5772-40da-821c-ab52b4cf5736 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:49.015676 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3b46558a-5772-40da-821c-ab52b4cf5736 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:49.354842 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-3b46558a-5772-40da-821c-ab52b4cf5736 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:49.368234 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-3b46558a-5772-40da-821c-ab52b4cf5736 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1759 microversion: 2.1 time: 0.379246 Jun 14 18:30:49.370923 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 270/508] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:48 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1759 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:49.685420 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-8768e7b0-0306-474f-8193-5a033dcb5249 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:49.686815 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-8768e7b0-0306-474f-8193-5a033dcb5249 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:49.690938 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_api:SELECT=93 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:30:49.697218 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8768e7b0-0306-474f-8193-5a033dcb5249 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:49.698263 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8768e7b0-0306-474f-8193-5a033dcb5249 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:49.708314 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8768e7b0-0306-474f-8193-5a033dcb5249 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:49.708314 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8768e7b0-0306-474f-8193-5a033dcb5249 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:50.067507 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-8768e7b0-0306-474f-8193-5a033dcb5249 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:50.075553 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-8768e7b0-0306-474f-8193-5a033dcb5249 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1664 microversion: 2.1 time: 0.395235 Jun 14 18:30:50.076209 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 239/509] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:49 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1664 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:50.911072 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-3cd10f8b-24d4-4062-9806-df5c5263d0e1 req-3eaa6d1e-cc08-4d3c-8d09-454d10fba24a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "023acd67-717e-45ef-abd2-936d81bbbccd", "tag": "9530bd2f-adfe-4346-b9ff-e6d39d227b3c"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:30:50.919798 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-3cd10f8b-24d4-4062-9806-df5c5263d0e1 req-3eaa6d1e-cc08-4d3c-8d09-454d10fba24a service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:50.920289 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-3cd10f8b-24d4-4062-9806-df5c5263d0e1 req-3eaa6d1e-cc08-4d3c-8d09-454d10fba24a service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:50.931822 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-3cd10f8b-24d4-4062-9806-df5c5263d0e1 req-3eaa6d1e-cc08-4d3c-8d09-454d10fba24a service nova] Creating event network-changed:9530bd2f-adfe-4346-b9ff-e6d39d227b3c for instance 023acd67-717e-45ef-abd2-936d81bbbccd on hv-cinder-84456 Jun 14 18:30:50.936600 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-3cd10f8b-24d4-4062-9806-df5c5263d0e1 req-3eaa6d1e-cc08-4d3c-8d09-454d10fba24a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029267 Jun 14 18:30:50.938054 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 271/510] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:30:51.102481 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-232d65ac-6993-4127-856a-dde64ae610d9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:51.103114 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-232d65ac-6993-4127-856a-dde64ae610d9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:51.110406 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-232d65ac-6993-4127-856a-dde64ae610d9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:51.110847 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-232d65ac-6993-4127-856a-dde64ae610d9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:51.111671 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-232d65ac-6993-4127-856a-dde64ae610d9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:51.112102 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-232d65ac-6993-4127-856a-dde64ae610d9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:51.242780 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-232d65ac-6993-4127-856a-dde64ae610d9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:51.250884 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-232d65ac-6993-4127-856a-dde64ae610d9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1668 microversion: 2.1 time: 0.152455 Jun 14 18:30:51.251432 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 240/511] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:51 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:55.683142 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-ef526850-9b1f-453a-8612-17216023dbd2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:30:55.684457 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-ef526850-9b1f-453a-8612-17216023dbd2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:55.691082 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ef526850-9b1f-453a-8612-17216023dbd2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:55.691526 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ef526850-9b1f-453a-8612-17216023dbd2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:55.692286 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ef526850-9b1f-453a-8612-17216023dbd2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:55.692722 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ef526850-9b1f-453a-8612-17216023dbd2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:55.715708 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.objects.instance [None req-ef526850-9b1f-453a-8612-17216023dbd2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lazy-loading 'flavor' on Instance uuid e66ffa48-038e-40ba-b075-bafc9eb4b015 {{(pid=118624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:30:56.141815 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-ef526850-9b1f-453a-8612-17216023dbd2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "POST /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015/action" status: 200 len: 32 microversion: 2.1 time: 0.463464 Jun 14 18:30:56.142433 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 272/512] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Jun 14 18:30:55 2022] POST /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015/action => generated 32 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 14 18:30:56.151654 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-67610fe4-46cf-42ae-941e-9e213c2e03af tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:56.152415 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-67610fe4-46cf-42ae-941e-9e213c2e03af tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:56.159191 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-67610fe4-46cf-42ae-941e-9e213c2e03af tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:56.159662 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-67610fe4-46cf-42ae-941e-9e213c2e03af tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:56.160429 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-67610fe4-46cf-42ae-941e-9e213c2e03af tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:56.160892 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-67610fe4-46cf-42ae-941e-9e213c2e03af tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:56.299165 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-67610fe4-46cf-42ae-941e-9e213c2e03af tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:56.307295 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-67610fe4-46cf-42ae-941e-9e213c2e03af tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1733 microversion: 2.1 time: 0.159499 Jun 14 18:30:56.307867 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 241/513] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:56 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:57.325962 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-a4c7a73f-a4e7-4572-9bee-2f33606f1ce6 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:57.326677 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-a4c7a73f-a4e7-4572-9bee-2f33606f1ce6 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:57.332843 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a4c7a73f-a4e7-4572-9bee-2f33606f1ce6 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:57.333278 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a4c7a73f-a4e7-4572-9bee-2f33606f1ce6 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:57.334070 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a4c7a73f-a4e7-4572-9bee-2f33606f1ce6 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:57.334497 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a4c7a73f-a4e7-4572-9bee-2f33606f1ce6 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:57.468928 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-a4c7a73f-a4e7-4572-9bee-2f33606f1ce6 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:57.477165 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-a4c7a73f-a4e7-4572-9bee-2f33606f1ce6 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1733 microversion: 2.1 time: 0.155889 Jun 14 18:30:57.477754 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 273/514] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:57 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:58.494730 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-c691bc9a-186e-4edc-bfde-1cda453d7143 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:58.495337 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-c691bc9a-186e-4edc-bfde-1cda453d7143 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:58.502700 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c691bc9a-186e-4edc-bfde-1cda453d7143 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:58.503145 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c691bc9a-186e-4edc-bfde-1cda453d7143 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:58.503900 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c691bc9a-186e-4edc-bfde-1cda453d7143 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:58.504326 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c691bc9a-186e-4edc-bfde-1cda453d7143 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:58.634881 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-c691bc9a-186e-4edc-bfde-1cda453d7143 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:58.643192 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-c691bc9a-186e-4edc-bfde-1cda453d7143 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1733 microversion: 2.1 time: 0.152495 Jun 14 18:30:58.643752 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 242/515] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:58 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:30:59.660678 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-a42db6e3-4460-489a-8cae-46f3ab366e2c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:30:59.661311 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-a42db6e3-4460-489a-8cae-46f3ab366e2c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:30:59.668015 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a42db6e3-4460-489a-8cae-46f3ab366e2c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:59.668459 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a42db6e3-4460-489a-8cae-46f3ab366e2c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:59.669204 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a42db6e3-4460-489a-8cae-46f3ab366e2c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:30:59.669668 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a42db6e3-4460-489a-8cae-46f3ab366e2c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:30:59.800948 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-a42db6e3-4460-489a-8cae-46f3ab366e2c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:30:59.809023 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-a42db6e3-4460-489a-8cae-46f3ab366e2c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1733 microversion: 2.1 time: 0.152143 Jun 14 18:30:59.809612 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 274/516] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:30:59 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:00.826761 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-58e868ba-f957-442a-ba55-1433c281c0e1 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:00.827895 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-58e868ba-f957-442a-ba55-1433c281c0e1 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:00.834330 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-58e868ba-f957-442a-ba55-1433c281c0e1 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:00.834773 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-58e868ba-f957-442a-ba55-1433c281c0e1 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:00.835515 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-58e868ba-f957-442a-ba55-1433c281c0e1 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:00.835947 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-58e868ba-f957-442a-ba55-1433c281c0e1 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:00.973683 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-58e868ba-f957-442a-ba55-1433c281c0e1 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:00.981573 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-58e868ba-f957-442a-ba55-1433c281c0e1 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1733 microversion: 2.1 time: 0.158625 Jun 14 18:31:00.982125 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 243/517] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:00 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:01.999223 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-76448c49-0e85-49ef-bcba-35412ca33ef9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:01.999825 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-76448c49-0e85-49ef-bcba-35412ca33ef9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:02.006989 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-76448c49-0e85-49ef-bcba-35412ca33ef9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:02.007435 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-76448c49-0e85-49ef-bcba-35412ca33ef9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:02.008196 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-76448c49-0e85-49ef-bcba-35412ca33ef9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:02.008628 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-76448c49-0e85-49ef-bcba-35412ca33ef9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:02.154091 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-76448c49-0e85-49ef-bcba-35412ca33ef9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:02.167110 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-76448c49-0e85-49ef-bcba-35412ca33ef9 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1733 microversion: 2.1 time: 0.171556 Jun 14 18:31:02.167800 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 275/518] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:01 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1733 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:03.185045 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-e6d8f388-4384-4040-84f4-3cfeadb201f0 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:03.185770 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-e6d8f388-4384-4040-84f4-3cfeadb201f0 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:03.193280 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e6d8f388-4384-4040-84f4-3cfeadb201f0 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:03.193754 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e6d8f388-4384-4040-84f4-3cfeadb201f0 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:03.194714 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e6d8f388-4384-4040-84f4-3cfeadb201f0 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:03.195043 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e6d8f388-4384-4040-84f4-3cfeadb201f0 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:03.322085 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-e6d8f388-4384-4040-84f4-3cfeadb201f0 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:03.329930 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-e6d8f388-4384-4040-84f4-3cfeadb201f0 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1733 microversion: 2.1 time: 0.148934 Jun 14 18:31:03.330537 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 244/519] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:03 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:04.347371 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-d0f16583-a552-4547-b84c-5369b4faf1e2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:04.347998 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-d0f16583-a552-4547-b84c-5369b4faf1e2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:04.350423 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_api:SELECT=70 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:31:04.355178 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d0f16583-a552-4547-b84c-5369b4faf1e2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:04.355657 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d0f16583-a552-4547-b84c-5369b4faf1e2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:04.356418 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d0f16583-a552-4547-b84c-5369b4faf1e2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:04.356853 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d0f16583-a552-4547-b84c-5369b4faf1e2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:04.372179 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:31:04.492969 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-d0f16583-a552-4547-b84c-5369b4faf1e2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:04.500851 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-d0f16583-a552-4547-b84c-5369b4faf1e2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1733 microversion: 2.1 time: 0.157465 Jun 14 18:31:04.501414 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 276/520] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:04 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:31:05.519403 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-5f505175-c245-4664-a254-4cdf4f8edb5c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:05.520042 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-5f505175-c245-4664-a254-4cdf4f8edb5c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:05.526564 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5f505175-c245-4664-a254-4cdf4f8edb5c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:05.527015 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5f505175-c245-4664-a254-4cdf4f8edb5c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:05.527793 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5f505175-c245-4664-a254-4cdf4f8edb5c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:05.528231 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5f505175-c245-4664-a254-4cdf4f8edb5c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:05.659893 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-5f505175-c245-4664-a254-4cdf4f8edb5c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:05.668478 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-5f505175-c245-4664-a254-4cdf4f8edb5c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1733 microversion: 2.1 time: 0.153635 Jun 14 18:31:05.669050 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 245/521] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:05 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:06.686218 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-44164859-0855-4634-90c8-c4910c25fc15 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:06.686872 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-44164859-0855-4634-90c8-c4910c25fc15 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:06.696173 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-44164859-0855-4634-90c8-c4910c25fc15 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:06.696627 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-44164859-0855-4634-90c8-c4910c25fc15 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:06.697408 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-44164859-0855-4634-90c8-c4910c25fc15 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:06.697868 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-44164859-0855-4634-90c8-c4910c25fc15 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:06.851896 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-44164859-0855-4634-90c8-c4910c25fc15 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:06.860728 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-44164859-0855-4634-90c8-c4910c25fc15 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1733 microversion: 2.1 time: 0.178345 Jun 14 18:31:06.861359 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 277/522] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:06 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1733 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:07.879078 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-b636e0c6-4991-4c2c-83ba-3664ecbd02d8 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:07.880326 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-b636e0c6-4991-4c2c-83ba-3664ecbd02d8 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:07.886346 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b636e0c6-4991-4c2c-83ba-3664ecbd02d8 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:07.886790 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b636e0c6-4991-4c2c-83ba-3664ecbd02d8 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:07.887598 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b636e0c6-4991-4c2c-83ba-3664ecbd02d8 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:07.888026 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b636e0c6-4991-4c2c-83ba-3664ecbd02d8 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:08.022369 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-b636e0c6-4991-4c2c-83ba-3664ecbd02d8 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:08.030444 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-b636e0c6-4991-4c2c-83ba-3664ecbd02d8 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1733 microversion: 2.1 time: 0.155652 Jun 14 18:31:08.030934 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 246/523] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:07 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:09.048443 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-25253adb-94d8-460b-8728-94bc56fc2e23 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:09.049088 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-25253adb-94d8-460b-8728-94bc56fc2e23 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:09.055851 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-25253adb-94d8-460b-8728-94bc56fc2e23 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:09.056296 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-25253adb-94d8-460b-8728-94bc56fc2e23 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:09.057049 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-25253adb-94d8-460b-8728-94bc56fc2e23 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:09.057501 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-25253adb-94d8-460b-8728-94bc56fc2e23 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:09.191371 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-25253adb-94d8-460b-8728-94bc56fc2e23 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:09.199980 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-25253adb-94d8-460b-8728-94bc56fc2e23 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1733 microversion: 2.1 time: 0.155152 Jun 14 18:31:09.200480 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 278/524] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:09 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:10.218317 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-54b6ad80-8783-4e75-a72d-2e008c4dd082 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:10.218892 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-54b6ad80-8783-4e75-a72d-2e008c4dd082 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:10.226217 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-54b6ad80-8783-4e75-a72d-2e008c4dd082 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:10.226708 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-54b6ad80-8783-4e75-a72d-2e008c4dd082 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:10.227466 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-54b6ad80-8783-4e75-a72d-2e008c4dd082 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:10.227896 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-54b6ad80-8783-4e75-a72d-2e008c4dd082 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:10.246398 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:31:10.363261 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-54b6ad80-8783-4e75-a72d-2e008c4dd082 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:10.371401 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-54b6ad80-8783-4e75-a72d-2e008c4dd082 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1733 microversion: 2.1 time: 0.157045 Jun 14 18:31:10.371942 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 247/525] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:10 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:11.387851 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-796718a0-96b8-4983-8f71-198e966396db tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:11.388596 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-796718a0-96b8-4983-8f71-198e966396db tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:11.395127 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-796718a0-96b8-4983-8f71-198e966396db tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:11.395626 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-796718a0-96b8-4983-8f71-198e966396db tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:11.396419 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-796718a0-96b8-4983-8f71-198e966396db tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:11.396855 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-796718a0-96b8-4983-8f71-198e966396db tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:11.531158 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-796718a0-96b8-4983-8f71-198e966396db tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:11.540197 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-796718a0-96b8-4983-8f71-198e966396db tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1733 microversion: 2.1 time: 0.155802 Jun 14 18:31:11.541037 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 279/526] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:11 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:12.558417 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-c265f243-3226-4a37-94f2-4a1bc300a304 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:12.559128 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-c265f243-3226-4a37-94f2-4a1bc300a304 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:12.565985 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c265f243-3226-4a37-94f2-4a1bc300a304 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:12.566413 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c265f243-3226-4a37-94f2-4a1bc300a304 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:12.567802 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c265f243-3226-4a37-94f2-4a1bc300a304 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:12.568231 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c265f243-3226-4a37-94f2-4a1bc300a304 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:12.699774 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-c265f243-3226-4a37-94f2-4a1bc300a304 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:12.707819 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-c265f243-3226-4a37-94f2-4a1bc300a304 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1733 microversion: 2.1 time: 0.153276 Jun 14 18:31:12.708380 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 248/527] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:12 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:13.724645 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-250cc3f1-4962-4a7e-9dbe-2101a7c544cf tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:13.725257 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-250cc3f1-4962-4a7e-9dbe-2101a7c544cf tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:13.731787 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-250cc3f1-4962-4a7e-9dbe-2101a7c544cf tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:13.732262 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-250cc3f1-4962-4a7e-9dbe-2101a7c544cf tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:13.733025 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-250cc3f1-4962-4a7e-9dbe-2101a7c544cf tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:13.733477 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-250cc3f1-4962-4a7e-9dbe-2101a7c544cf tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:13.865030 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-250cc3f1-4962-4a7e-9dbe-2101a7c544cf tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:13.874359 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-250cc3f1-4962-4a7e-9dbe-2101a7c544cf tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1733 microversion: 2.1 time: 0.154107 Jun 14 18:31:13.874937 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 280/528] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:13 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:14.893321 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-dd281b6d-5012-46fc-b169-a4091395dbcf tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:14.894096 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-dd281b6d-5012-46fc-b169-a4091395dbcf tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:14.901804 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-dd281b6d-5012-46fc-b169-a4091395dbcf tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:14.902311 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-dd281b6d-5012-46fc-b169-a4091395dbcf tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:14.903099 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-dd281b6d-5012-46fc-b169-a4091395dbcf tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:14.903532 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-dd281b6d-5012-46fc-b169-a4091395dbcf tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:15.061124 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-dd281b6d-5012-46fc-b169-a4091395dbcf tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:15.070118 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-dd281b6d-5012-46fc-b169-a4091395dbcf tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1733 microversion: 2.1 time: 0.180602 Jun 14 18:31:15.070702 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 249/529] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:14 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1733 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:16.087768 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-58da58bb-9877-4323-be38-6665ad179276 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:16.088372 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-58da58bb-9877-4323-be38-6665ad179276 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:16.094933 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-58da58bb-9877-4323-be38-6665ad179276 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:16.095442 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-58da58bb-9877-4323-be38-6665ad179276 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:16.096223 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-58da58bb-9877-4323-be38-6665ad179276 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:16.096651 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-58da58bb-9877-4323-be38-6665ad179276 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:16.229247 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-58da58bb-9877-4323-be38-6665ad179276 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:16.237857 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-58da58bb-9877-4323-be38-6665ad179276 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1733 microversion: 2.1 time: 0.154003 Jun 14 18:31:16.242321 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 281/530] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:16 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:17.257311 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-8a327cfa-2c59-44f3-ba8e-b871b6f5676c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:17.258003 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-8a327cfa-2c59-44f3-ba8e-b871b6f5676c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:17.264855 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8a327cfa-2c59-44f3-ba8e-b871b6f5676c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:17.265303 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8a327cfa-2c59-44f3-ba8e-b871b6f5676c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:17.266109 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8a327cfa-2c59-44f3-ba8e-b871b6f5676c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:17.266724 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8a327cfa-2c59-44f3-ba8e-b871b6f5676c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:17.407999 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-8a327cfa-2c59-44f3-ba8e-b871b6f5676c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:17.417265 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-8a327cfa-2c59-44f3-ba8e-b871b6f5676c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1713 microversion: 2.1 time: 0.164300 Jun 14 18:31:17.417904 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 250/531] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:17 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1713 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:17.530028 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-77b54e03-4783-4068-bbbe-e111fd6e2bd3 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:17.530646 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-77b54e03-4783-4068-bbbe-e111fd6e2bd3 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:17.537305 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-77b54e03-4783-4068-bbbe-e111fd6e2bd3 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:17.537782 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-77b54e03-4783-4068-bbbe-e111fd6e2bd3 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:17.538555 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-77b54e03-4783-4068-bbbe-e111fd6e2bd3 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:17.538984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-77b54e03-4783-4068-bbbe-e111fd6e2bd3 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:17.624440 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.wsgi [None req-77b54e03-4783-4068-bbbe-e111fd6e2bd3 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] HTTP exception thrown: Cannot 'detach_volume' instance e66ffa48-038e-40ba-b075-bafc9eb4b015 while it is in vm_state rescued Jun 14 18:31:17.626088 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-77b54e03-4783-4068-bbbe-e111fd6e2bd3 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Request method failure captured: Jun 14 18:31:17.626088 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: request: DELETE /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015/os-volume_attachments/402021d3-07bc-4453-9422-1aa4fb65a611 HTTP/1.1 Jun 14 18:31:17.626088 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept: application/json Jun 14 18:31:17.626088 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept-Encoding: identity Jun 14 18:31:17.626088 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Connection: close Jun 14 18:31:17.626088 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Length: 0 Jun 14 18:31:17.626088 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Type: application/json Jun 14 18:31:17.626088 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Host: 10.222.0.78 Jun 14 18:31:17.626088 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Openstack-System-Scope: None Jun 14 18:31:17.626088 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: User-Agent: python-urllib3/1.26.9 Jun 14 18:31:17.626088 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Auth-Token: gAAAAABiqNMLmsc67uKqI-N-C_X_FhrUcqjTvgCN_KzDpDCXteEoTPgrRoD6Ywb_SWbZmcccxpWD5TO2tWjenTUuj22mzrGN0E1HFTTIaMbUD5cHq7A5utVjIauxMwF4xyAg3dOi-qAU6NI2QSJxQv20Gtu9ypjDarfFBE2B0JV-w4G2UG_jGvU Jun 14 18:31:17.626088 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Id: None Jun 14 18:31:17.626088 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Name: None Jun 14 18:31:17.626088 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Identity-Status: Confirmed Jun 14 18:31:17.626088 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Is-Admin-Project: True Jun 14 18:31:17.626088 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Id: default Jun 14 18:31:17.626088 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Name: Default Jun 14 18:31:17.626088 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Id: a5c99e2733b440cc99c9749761f4b4cd Jun 14 18:31:17.626088 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2012041525 Jun 14 18:31:17.626088 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Role: reader,member Jun 14 18:31:17.626088 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Roles: reader,member Jun 14 18:31:17.627585 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a5c99e2733b440cc99c9749761f4b4cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a5c99e2733b440cc99c9749761f4b4cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a5c99e2733b440cc99c9749761f4b4cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a5c99e2733b440cc99c9749761f4b4cd"}]}] Jun 14 18:31:17.627585 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2012041525 Jun 14 18:31:17.627585 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Id: a5c99e2733b440cc99c9749761f4b4cd Jun 14 18:31:17.627585 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2012041525 Jun 14 18:31:17.627585 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User: tempest-ServerRescueNegativeTestJSON-2012041525-project Jun 14 18:31:17.627585 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Id: default Jun 14 18:31:17.627585 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Name: Default Jun 14 18:31:17.627585 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Id: 7bf1c044cb3843b4a54edd75a3f04685 Jun 14 18:31:17.627585 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2012041525-project Jun 14 18:31:17.627585 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: method: > Jun 14 18:31:17.627585 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: exception: Cannot 'detach_volume' instance e66ffa48-038e-40ba-b075-bafc9eb4b015 while it is in vm_state rescued Jun 14 18:31:17.628565 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: action_args: {'server_id': 'e66ffa48-038e-40ba-b075-bafc9eb4b015', 'id': '402021d3-07bc-4453-9422-1aa4fb65a611'} Jun 14 18:31:17.628565 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:31:17.628565 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:31:17.628565 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 14 18:31:17.628565 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 14 18:31:17.628565 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 14 18:31:17.628565 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 14 18:31:17.628565 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 14 18:31:17.628565 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 14 18:31:17.628565 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e66ffa48-038e-40ba-b075-bafc9eb4b015 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 14 18:31:17.628565 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:31:17.628565 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:31:17.628565 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:31:17.628565 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:31:17.628565 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:31:17.628565 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:31:17.628565 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:31:17.628565 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:31:17.628565 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:31:17.628565 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:31:17.631407 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 14 18:31:17.631407 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 14 18:31:17.631407 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 14 18:31:17.631407 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 14 18:31:17.631407 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e66ffa48-038e-40ba-b075-bafc9eb4b015 while it is in vm_state rescued Jun 14 18:31:17.631407 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:31:17.631407 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:31:17.631407 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:31:17.631407 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:31:17.631407 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:31:17.631407 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:31:17.631407 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:31:17.631407 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:31:17.631407 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e66ffa48-038e-40ba-b075-bafc9eb4b015 while it is in vm_state rescued Jun 14 18:31:17.631407 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:31:17.631407 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-77b54e03-4783-4068-bbbe-e111fd6e2bd3 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Returning 409 to user: Cannot 'detach_volume' instance e66ffa48-038e-40ba-b075-bafc9eb4b015 while it is in vm_state rescued {{(pid=118624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:31:17.633334 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-77b54e03-4783-4068-bbbe-e111fd6e2bd3 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015/os-volume_attachments/402021d3-07bc-4453-9422-1aa4fb65a611" status: 409 len: 152 microversion: 2.1 time: 0.101767 Jun 14 18:31:17.633334 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 282/532] 10.222.0.78 () {58 vars in 1415 bytes} [Tue Jun 14 18:31:17 2022] DELETE /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015/os-volume_attachments/402021d3-07bc-4453-9422-1aa4fb65a611 => generated 152 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 14 18:31:17.637483 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-d808594d-bb85-4d87-82b2-de908f81cbb4 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:31:17.638026 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-d808594d-bb85-4d87-82b2-de908f81cbb4 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:17.644160 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d808594d-bb85-4d87-82b2-de908f81cbb4 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:17.644610 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d808594d-bb85-4d87-82b2-de908f81cbb4 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:17.646123 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d808594d-bb85-4d87-82b2-de908f81cbb4 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:17.646559 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d808594d-bb85-4d87-82b2-de908f81cbb4 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:17.867159 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-d808594d-bb85-4d87-82b2-de908f81cbb4 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "POST /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015/action" status: 202 len: 0 microversion: 2.1 time: 0.233283 Jun 14 18:31:17.867761 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 251/533] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Jun 14 18:31:17 2022] POST /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 14 18:31:17.880941 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-8031ed99-9358-4cfd-abeb-51c2d24b221b tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:17.881732 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-8031ed99-9358-4cfd-abeb-51c2d24b221b tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:17.889938 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8031ed99-9358-4cfd-abeb-51c2d24b221b tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:17.890391 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8031ed99-9358-4cfd-abeb-51c2d24b221b tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:17.891163 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8031ed99-9358-4cfd-abeb-51c2d24b221b tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:17.891714 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8031ed99-9358-4cfd-abeb-51c2d24b221b tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:18.045625 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-8031ed99-9358-4cfd-abeb-51c2d24b221b tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:18.054745 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-8031ed99-9358-4cfd-abeb-51c2d24b221b tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1721 microversion: 2.1 time: 0.180317 Jun 14 18:31:18.055444 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 283/534] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:17 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:31:18.592739 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-2a8fa372-fe78-42de-87cb-4e0e0fb7f79e tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:31:18.593642 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-2a8fa372-fe78-42de-87cb-4e0e0fb7f79e tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:18.600499 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2a8fa372-fe78-42de-87cb-4e0e0fb7f79e tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:18.603203 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2a8fa372-fe78-42de-87cb-4e0e0fb7f79e tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:18.603203 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2a8fa372-fe78-42de-87cb-4e0e0fb7f79e tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:18.603203 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2a8fa372-fe78-42de-87cb-4e0e0fb7f79e tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:18.878319 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-2a8fa372-fe78-42de-87cb-4e0e0fb7f79e tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "POST /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd/action" status: 202 len: 0 microversion: 2.1 time: 0.290320 Jun 14 18:31:18.878874 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 252/535] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Jun 14 18:31:18 2022] POST /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:31:18.887569 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-d7e0ed8f-8534-43dd-ae12-bfaa2bf21231 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:18.888179 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-d7e0ed8f-8534-43dd-ae12-bfaa2bf21231 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:18.894759 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d7e0ed8f-8534-43dd-ae12-bfaa2bf21231 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:18.895202 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d7e0ed8f-8534-43dd-ae12-bfaa2bf21231 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:18.896073 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d7e0ed8f-8534-43dd-ae12-bfaa2bf21231 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:18.896507 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d7e0ed8f-8534-43dd-ae12-bfaa2bf21231 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:19.041761 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-d7e0ed8f-8534-43dd-ae12-bfaa2bf21231 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:19.049711 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-d7e0ed8f-8534-43dd-ae12-bfaa2bf21231 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1751 microversion: 2.1 time: 0.165935 Jun 14 18:31:19.050275 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 284/536] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:18 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:31:19.072878 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-1d4fa359-5eb5-48d0-b4cd-82002ad98cb1 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:19.073742 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-1d4fa359-5eb5-48d0-b4cd-82002ad98cb1 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:19.079986 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1d4fa359-5eb5-48d0-b4cd-82002ad98cb1 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:19.080436 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1d4fa359-5eb5-48d0-b4cd-82002ad98cb1 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:19.081196 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1d4fa359-5eb5-48d0-b4cd-82002ad98cb1 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:19.081687 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1d4fa359-5eb5-48d0-b4cd-82002ad98cb1 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:19.209871 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-1d4fa359-5eb5-48d0-b4cd-82002ad98cb1 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:19.217931 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-1d4fa359-5eb5-48d0-b4cd-82002ad98cb1 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1721 microversion: 2.1 time: 0.149274 Jun 14 18:31:19.218470 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 253/537] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:19 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:20.068483 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-1c33aac0-d3b4-440e-abec-58177f98f5de tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:20.082263 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-1c33aac0-d3b4-440e-abec-58177f98f5de tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:20.082263 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1c33aac0-d3b4-440e-abec-58177f98f5de tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:20.082263 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1c33aac0-d3b4-440e-abec-58177f98f5de tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:20.082263 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1c33aac0-d3b4-440e-abec-58177f98f5de tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:20.082695 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1c33aac0-d3b4-440e-abec-58177f98f5de tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:20.230334 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-1c33aac0-d3b4-440e-abec-58177f98f5de tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:20.235522 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-0a160df0-f8bd-4215-a590-d2161f27bfab tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:20.236139 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-0a160df0-f8bd-4215-a590-d2161f27bfab tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:20.239124 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_api:SELECT=30 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:31:20.239294 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-1c33aac0-d3b4-440e-abec-58177f98f5de tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1751 microversion: 2.1 time: 0.175007 Jun 14 18:31:20.239744 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 285/538] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:20 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1751 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:20.244096 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0a160df0-f8bd-4215-a590-d2161f27bfab tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:20.244552 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0a160df0-f8bd-4215-a590-d2161f27bfab tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:20.245324 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0a160df0-f8bd-4215-a590-d2161f27bfab tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:20.245792 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0a160df0-f8bd-4215-a590-d2161f27bfab tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:20.386019 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-0a160df0-f8bd-4215-a590-d2161f27bfab tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:20.394430 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-0a160df0-f8bd-4215-a590-d2161f27bfab tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1721 microversion: 2.1 time: 0.162617 Jun 14 18:31:20.395273 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 254/539] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:20 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:31:21.257200 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-cebecda4-e54b-4c82-b141-3c4f946d9381 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:21.257830 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-cebecda4-e54b-4c82-b141-3c4f946d9381 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:21.264409 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-cebecda4-e54b-4c82-b141-3c4f946d9381 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:21.264855 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-cebecda4-e54b-4c82-b141-3c4f946d9381 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:21.265654 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-cebecda4-e54b-4c82-b141-3c4f946d9381 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:21.266092 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-cebecda4-e54b-4c82-b141-3c4f946d9381 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:21.411220 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-dac7fcc9-74f3-4439-9d79-6326cc57ecaf tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:21.411729 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-cebecda4-e54b-4c82-b141-3c4f946d9381 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:21.411837 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-dac7fcc9-74f3-4439-9d79-6326cc57ecaf tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:21.420939 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-cebecda4-e54b-4c82-b141-3c4f946d9381 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1751 microversion: 2.1 time: 0.168382 Jun 14 18:31:21.421274 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-dac7fcc9-74f3-4439-9d79-6326cc57ecaf tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:21.421645 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-dac7fcc9-74f3-4439-9d79-6326cc57ecaf tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:21.421971 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 286/540] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:21 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:21.433186 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-dac7fcc9-74f3-4439-9d79-6326cc57ecaf tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:21.434193 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-dac7fcc9-74f3-4439-9d79-6326cc57ecaf tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:21.585749 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-dac7fcc9-74f3-4439-9d79-6326cc57ecaf tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:21.594332 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-dac7fcc9-74f3-4439-9d79-6326cc57ecaf tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1721 microversion: 2.1 time: 0.187251 Jun 14 18:31:21.601408 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 255/541] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:21 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:31:22.437833 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-1d585e0c-8510-41ed-9bc0-da7b9142b02a tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:22.438461 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-1d585e0c-8510-41ed-9bc0-da7b9142b02a tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:22.445524 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1d585e0c-8510-41ed-9bc0-da7b9142b02a tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:22.445976 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1d585e0c-8510-41ed-9bc0-da7b9142b02a tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:22.446745 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1d585e0c-8510-41ed-9bc0-da7b9142b02a tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:22.447177 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1d585e0c-8510-41ed-9bc0-da7b9142b02a tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:22.603424 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-1d585e0c-8510-41ed-9bc0-da7b9142b02a tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:22.612300 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-b40322f3-3d70-43fc-898e-43e1a7a6e2d2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:22.612856 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-1d585e0c-8510-41ed-9bc0-da7b9142b02a tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1756 microversion: 2.1 time: 0.178475 Jun 14 18:31:22.612965 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-b40322f3-3d70-43fc-898e-43e1a7a6e2d2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:22.613099 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 287/542] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:22 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:22.622387 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b40322f3-3d70-43fc-898e-43e1a7a6e2d2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:22.623154 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b40322f3-3d70-43fc-898e-43e1a7a6e2d2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:22.624550 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b40322f3-3d70-43fc-898e-43e1a7a6e2d2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:22.625430 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b40322f3-3d70-43fc-898e-43e1a7a6e2d2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:22.775368 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-b40322f3-3d70-43fc-898e-43e1a7a6e2d2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:22.783995 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-b40322f3-3d70-43fc-898e-43e1a7a6e2d2 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1727 microversion: 2.1 time: 0.175960 Jun 14 18:31:22.784493 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 256/543] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:22 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:31:22.801392 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-a1733f04-8dd9-4c03-988d-6d6d1fbbab6e tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:22.801913 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-a1733f04-8dd9-4c03-988d-6d6d1fbbab6e tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:22.808290 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a1733f04-8dd9-4c03-988d-6d6d1fbbab6e tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:22.808740 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a1733f04-8dd9-4c03-988d-6d6d1fbbab6e tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:22.809579 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a1733f04-8dd9-4c03-988d-6d6d1fbbab6e tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:22.810014 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a1733f04-8dd9-4c03-988d-6d6d1fbbab6e tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:22.893038 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-a1733f04-8dd9-4c03-988d-6d6d1fbbab6e tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095624 Jun 14 18:31:22.893706 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 288/544] 10.222.0.78 () {58 vars in 1274 bytes} [Tue Jun 14 18:31:22 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:31:23.631053 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-8ab65c88-f230-4349-ac48-c223efb2b6db tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:23.632064 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-8ab65c88-f230-4349-ac48-c223efb2b6db tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:23.638738 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8ab65c88-f230-4349-ac48-c223efb2b6db tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:23.639191 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8ab65c88-f230-4349-ac48-c223efb2b6db tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:23.640098 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8ab65c88-f230-4349-ac48-c223efb2b6db tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:23.640555 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8ab65c88-f230-4349-ac48-c223efb2b6db tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:23.787739 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-8ab65c88-f230-4349-ac48-c223efb2b6db tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:23.796140 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-8ab65c88-f230-4349-ac48-c223efb2b6db tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1756 microversion: 2.1 time: 0.169600 Jun 14 18:31:23.796703 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 257/545] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:23 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:23.854277 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-3ae32855-ff3d-4666-b8aa-b164800a876d req-1e2c3946-f756-4470-af63-bc08bffb491b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e66ffa48-038e-40ba-b075-bafc9eb4b015", "tag": "6e99f823-8a81-4709-b6d7-f5393c08507e"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:31:23.862730 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-3ae32855-ff3d-4666-b8aa-b164800a876d req-1e2c3946-f756-4470-af63-bc08bffb491b service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:23.863262 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-3ae32855-ff3d-4666-b8aa-b164800a876d req-1e2c3946-f756-4470-af63-bc08bffb491b service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:23.875688 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-3ae32855-ff3d-4666-b8aa-b164800a876d req-1e2c3946-f756-4470-af63-bc08bffb491b service nova] Creating event network-changed:6e99f823-8a81-4709-b6d7-f5393c08507e for instance e66ffa48-038e-40ba-b075-bafc9eb4b015 on hv-cinder-84456 Jun 14 18:31:23.882079 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-3ae32855-ff3d-4666-b8aa-b164800a876d req-1e2c3946-f756-4470-af63-bc08bffb491b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031258 Jun 14 18:31:23.882524 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 289/546] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:31:24.812983 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-373e1e39-cf1d-40ad-8c0c-11d42fe2bd94 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:24.813634 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-373e1e39-cf1d-40ad-8c0c-11d42fe2bd94 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:24.820905 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-373e1e39-cf1d-40ad-8c0c-11d42fe2bd94 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:24.821360 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-373e1e39-cf1d-40ad-8c0c-11d42fe2bd94 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:24.822166 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-373e1e39-cf1d-40ad-8c0c-11d42fe2bd94 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:24.822608 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-373e1e39-cf1d-40ad-8c0c-11d42fe2bd94 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:24.971293 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-373e1e39-cf1d-40ad-8c0c-11d42fe2bd94 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:24.979685 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-373e1e39-cf1d-40ad-8c0c-11d42fe2bd94 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1756 microversion: 2.1 time: 0.170510 Jun 14 18:31:24.980380 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 258/547] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:24 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:25.897378 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-a9f747b1-8eaf-4fb6-944e-e837f369bf4c req-9a33fe96-c5bf-439a-8c1a-949d9f28726c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e66ffa48-038e-40ba-b075-bafc9eb4b015", "tag": "6e99f823-8a81-4709-b6d7-f5393c08507e"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:31:25.905807 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-a9f747b1-8eaf-4fb6-944e-e837f369bf4c req-9a33fe96-c5bf-439a-8c1a-949d9f28726c service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:25.906253 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-a9f747b1-8eaf-4fb6-944e-e837f369bf4c req-9a33fe96-c5bf-439a-8c1a-949d9f28726c service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:25.918395 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-a9f747b1-8eaf-4fb6-944e-e837f369bf4c req-9a33fe96-c5bf-439a-8c1a-949d9f28726c service nova] Creating event network-changed:6e99f823-8a81-4709-b6d7-f5393c08507e for instance e66ffa48-038e-40ba-b075-bafc9eb4b015 on hv-cinder-84456 Jun 14 18:31:25.923764 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-a9f747b1-8eaf-4fb6-944e-e837f369bf4c req-9a33fe96-c5bf-439a-8c1a-949d9f28726c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031149 Jun 14 18:31:25.924358 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 290/548] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:31:25.997526 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-fe63f5c3-feab-45f5-88ea-4a66185b2e5f tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:25.998119 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-fe63f5c3-feab-45f5-88ea-4a66185b2e5f tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:26.004844 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-fe63f5c3-feab-45f5-88ea-4a66185b2e5f tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:26.005881 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-fe63f5c3-feab-45f5-88ea-4a66185b2e5f tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:26.007159 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-fe63f5c3-feab-45f5-88ea-4a66185b2e5f tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:26.007472 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-fe63f5c3-feab-45f5-88ea-4a66185b2e5f tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:26.164688 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-fe63f5c3-feab-45f5-88ea-4a66185b2e5f tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:26.173381 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-fe63f5c3-feab-45f5-88ea-4a66185b2e5f tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1756 microversion: 2.1 time: 0.179782 Jun 14 18:31:26.174000 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 259/549] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:25 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:27.192293 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-5599b733-81a7-423b-8ed5-685211251c83 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:27.193702 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-5599b733-81a7-423b-8ed5-685211251c83 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:27.200023 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5599b733-81a7-423b-8ed5-685211251c83 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:27.200468 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5599b733-81a7-423b-8ed5-685211251c83 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:27.201216 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5599b733-81a7-423b-8ed5-685211251c83 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:27.201678 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5599b733-81a7-423b-8ed5-685211251c83 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:27.347052 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-5599b733-81a7-423b-8ed5-685211251c83 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:27.355372 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-5599b733-81a7-423b-8ed5-685211251c83 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1756 microversion: 2.1 time: 0.167829 Jun 14 18:31:27.355935 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 291/550] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:27 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:28.372180 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-d12c544f-4cd0-4abb-89cf-34890863fad1 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:28.372714 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-d12c544f-4cd0-4abb-89cf-34890863fad1 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:28.379541 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d12c544f-4cd0-4abb-89cf-34890863fad1 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:28.380064 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d12c544f-4cd0-4abb-89cf-34890863fad1 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:28.380968 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d12c544f-4cd0-4abb-89cf-34890863fad1 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:28.381521 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d12c544f-4cd0-4abb-89cf-34890863fad1 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:28.526543 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-d12c544f-4cd0-4abb-89cf-34890863fad1 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:28.534800 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-d12c544f-4cd0-4abb-89cf-34890863fad1 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1756 microversion: 2.1 time: 0.166791 Jun 14 18:31:28.535401 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 260/551] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:28 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:29.553426 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-eb96a695-944a-4b53-b2b4-42ca64a4ecb3 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:29.554128 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-eb96a695-944a-4b53-b2b4-42ca64a4ecb3 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:29.561876 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-eb96a695-944a-4b53-b2b4-42ca64a4ecb3 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:29.562320 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-eb96a695-944a-4b53-b2b4-42ca64a4ecb3 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:29.563103 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-eb96a695-944a-4b53-b2b4-42ca64a4ecb3 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:29.563575 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-eb96a695-944a-4b53-b2b4-42ca64a4ecb3 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:29.707228 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-eb96a695-944a-4b53-b2b4-42ca64a4ecb3 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:29.715998 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-eb96a695-944a-4b53-b2b4-42ca64a4ecb3 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1756 microversion: 2.1 time: 0.166445 Jun 14 18:31:29.716577 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 292/552] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:29 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:30.733307 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-e3a23577-c255-407a-bb72-6933cf86c715 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:30.734038 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-e3a23577-c255-407a-bb72-6933cf86c715 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:30.740926 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e3a23577-c255-407a-bb72-6933cf86c715 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:30.741924 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e3a23577-c255-407a-bb72-6933cf86c715 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:30.742752 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e3a23577-c255-407a-bb72-6933cf86c715 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:30.743206 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e3a23577-c255-407a-bb72-6933cf86c715 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:30.896266 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-e3a23577-c255-407a-bb72-6933cf86c715 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:30.904550 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-e3a23577-c255-407a-bb72-6933cf86c715 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1756 microversion: 2.1 time: 0.175200 Jun 14 18:31:30.905112 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 261/553] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:30 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:31.922341 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-1d99f0c7-b8c6-4d51-8dc3-61479652628a tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:31.922940 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-1d99f0c7-b8c6-4d51-8dc3-61479652628a tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:31.930568 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1d99f0c7-b8c6-4d51-8dc3-61479652628a tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:31.931026 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1d99f0c7-b8c6-4d51-8dc3-61479652628a tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:31.931826 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1d99f0c7-b8c6-4d51-8dc3-61479652628a tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:31.932265 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1d99f0c7-b8c6-4d51-8dc3-61479652628a tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:32.100186 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-1d99f0c7-b8c6-4d51-8dc3-61479652628a tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:32.109684 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-1d99f0c7-b8c6-4d51-8dc3-61479652628a tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1756 microversion: 2.1 time: 0.191187 Jun 14 18:31:32.110263 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 293/554] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:31 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1756 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:33.126842 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-289f49a1-c1fd-4c62-a938-d89da0787307 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:33.127490 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-289f49a1-c1fd-4c62-a938-d89da0787307 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:33.135176 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-289f49a1-c1fd-4c62-a938-d89da0787307 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:33.135622 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-289f49a1-c1fd-4c62-a938-d89da0787307 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:33.136395 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-289f49a1-c1fd-4c62-a938-d89da0787307 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:33.136820 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-289f49a1-c1fd-4c62-a938-d89da0787307 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:33.153841 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:31:33.302845 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-289f49a1-c1fd-4c62-a938-d89da0787307 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:33.312663 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-289f49a1-c1fd-4c62-a938-d89da0787307 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1756 microversion: 2.1 time: 0.189726 Jun 14 18:31:33.313380 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 262/555] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:33 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1756 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:34.181224 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-7882ad1b-4f47-4216-b580-1b8c5a196a58 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:34.181796 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-7882ad1b-4f47-4216-b580-1b8c5a196a58 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:34.188472 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7882ad1b-4f47-4216-b580-1b8c5a196a58 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:34.188922 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7882ad1b-4f47-4216-b580-1b8c5a196a58 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:34.189717 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7882ad1b-4f47-4216-b580-1b8c5a196a58 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:34.190152 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7882ad1b-4f47-4216-b580-1b8c5a196a58 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:34.217400 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell1:SELECT=100 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:31:34.221317 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-7882ad1b-4f47-4216-b580-1b8c5a196a58 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2/os-volume_attachments/3df88755-2057-435a-80ec-93e1de992588" status: 200 len: 194 microversion: 2.20 time: 0.044354 Jun 14 18:31:34.221957 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 294/556] 10.222.0.78 () {60 vars in 1453 bytes} [Tue Jun 14 18:31:34 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2/os-volume_attachments/3df88755-2057-435a-80ec-93e1de992588 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 18:31:34.284732 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-39c76cd3-50bc-4ca0-a530-d16e75a80348 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:34.285370 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-39c76cd3-50bc-4ca0-a530-d16e75a80348 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:34.292566 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-39c76cd3-50bc-4ca0-a530-d16e75a80348 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:34.293018 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-39c76cd3-50bc-4ca0-a530-d16e75a80348 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:34.293849 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-39c76cd3-50bc-4ca0-a530-d16e75a80348 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:34.294362 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-39c76cd3-50bc-4ca0-a530-d16e75a80348 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:34.331329 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-c5ed1be7-1126-45b5-82be-9bf7fc884be9 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:34.331956 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-c5ed1be7-1126-45b5-82be-9bf7fc884be9 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:34.338376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c5ed1be7-1126-45b5-82be-9bf7fc884be9 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:34.338826 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c5ed1be7-1126-45b5-82be-9bf7fc884be9 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:34.339606 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c5ed1be7-1126-45b5-82be-9bf7fc884be9 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:34.340048 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c5ed1be7-1126-45b5-82be-9bf7fc884be9 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:34.441711 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.objects.instance [None req-39c76cd3-50bc-4ca0-a530-d16e75a80348 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lazy-loading 'services' on Instance uuid 2876875b-5dbe-4032-949a-3357292296a2 {{(pid=118623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:31:34.511508 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-c5ed1be7-1126-45b5-82be-9bf7fc884be9 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:34.520026 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-c5ed1be7-1126-45b5-82be-9bf7fc884be9 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1756 microversion: 2.1 time: 0.192895 Jun 14 18:31:34.520678 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 295/557] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:34 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1756 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:31:34.699181 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-39c76cd3-50bc-4ca0-a530-d16e75a80348 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2/os-volume_attachments/3df88755-2057-435a-80ec-93e1de992588" status: 202 len: 0 microversion: 2.20 time: 0.418494 Jun 14 18:31:34.699773 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 263/558] 10.222.0.78 () {60 vars in 1456 bytes} [Tue Jun 14 18:31:34 2022] DELETE /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2/os-volume_attachments/3df88755-2057-435a-80ec-93e1de992588 => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 14 18:31:34.708159 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-a4504687-9ed8-455c-809d-c2bc8759a153 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:34.709115 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-a4504687-9ed8-455c-809d-c2bc8759a153 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:34.712468 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_api:SELECT=40 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:31:34.715998 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a4504687-9ed8-455c-809d-c2bc8759a153 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:34.716445 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a4504687-9ed8-455c-809d-c2bc8759a153 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:34.717227 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a4504687-9ed8-455c-809d-c2bc8759a153 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:34.717697 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a4504687-9ed8-455c-809d-c2bc8759a153 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:34.765573 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-a4504687-9ed8-455c-809d-c2bc8759a153 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060968 Jun 14 18:31:34.766353 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 296/559] 10.222.0.78 () {60 vars in 1342 bytes} [Tue Jun 14 18:31:34 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 18:31:35.538426 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-c9566cd4-a783-438c-bb21-88613e6cced1 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:35.539918 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-c9566cd4-a783-438c-bb21-88613e6cced1 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:35.547126 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c9566cd4-a783-438c-bb21-88613e6cced1 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:35.547709 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c9566cd4-a783-438c-bb21-88613e6cced1 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:35.548487 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c9566cd4-a783-438c-bb21-88613e6cced1 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:35.548933 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c9566cd4-a783-438c-bb21-88613e6cced1 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:35.707882 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-c9566cd4-a783-438c-bb21-88613e6cced1 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:35.717085 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-c9566cd4-a783-438c-bb21-88613e6cced1 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1756 microversion: 2.1 time: 0.183596 Jun 14 18:31:35.717695 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 264/560] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:35 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:35.780063 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-d0b66ad7-3bdb-493f-8e3b-fc4c6bf62851 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:35.781010 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-d0b66ad7-3bdb-493f-8e3b-fc4c6bf62851 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:35.788175 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d0b66ad7-3bdb-493f-8e3b-fc4c6bf62851 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:35.788550 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d0b66ad7-3bdb-493f-8e3b-fc4c6bf62851 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:35.789949 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d0b66ad7-3bdb-493f-8e3b-fc4c6bf62851 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:35.790779 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d0b66ad7-3bdb-493f-8e3b-fc4c6bf62851 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:35.821355 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-d0b66ad7-3bdb-493f-8e3b-fc4c6bf62851 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045198 Jun 14 18:31:35.821974 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 297/561] 10.222.0.78 () {60 vars in 1342 bytes} [Tue Jun 14 18:31:35 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 18:31:36.372969 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-b04d969f-9f39-4654-b49d-804240376b37 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:36.373482 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-b04d969f-9f39-4654-b49d-804240376b37 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:36.379544 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b04d969f-9f39-4654-b49d-804240376b37 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:36.379987 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b04d969f-9f39-4654-b49d-804240376b37 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:36.380738 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b04d969f-9f39-4654-b49d-804240376b37 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:36.381173 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b04d969f-9f39-4654-b49d-804240376b37 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:36.404791 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-b04d969f-9f39-4654-b49d-804240376b37 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726/ips" status: 200 len: 149 microversion: 2.1 time: 0.035962 Jun 14 18:31:36.405362 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 265/562] 10.222.0.78 () {58 vars in 1247 bytes} [Tue Jun 14 18:31:36 2022] GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:31:36.416344 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-241a70c7-b5e5-457f-a36e-20ae90e82769 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2899039d-b3ca-488b-b808-026c69f98f82"}} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:31:36.417402 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-241a70c7-b5e5-457f-a36e-20ae90e82769 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:36.426575 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-241a70c7-b5e5-457f-a36e-20ae90e82769 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:36.427021 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-241a70c7-b5e5-457f-a36e-20ae90e82769 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:36.427793 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-241a70c7-b5e5-457f-a36e-20ae90e82769 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:36.428228 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-241a70c7-b5e5-457f-a36e-20ae90e82769 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:36.514966 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.wsgi [None req-241a70c7-b5e5-457f-a36e-20ae90e82769 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] HTTP exception thrown: Invalid volume: volume 2899039d-b3ca-488b-b808-026c69f98f82 is already attached to instances: 17641e09-70b6-4020-9fb5-31780056f2d9 Jun 14 18:31:36.516684 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-241a70c7-b5e5-457f-a36e-20ae90e82769 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Request method failure captured: Jun 14 18:31:36.516684 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: request: POST /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726/os-volume_attachments HTTP/1.1 Jun 14 18:31:36.516684 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept: application/json Jun 14 18:31:36.516684 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept-Encoding: identity Jun 14 18:31:36.516684 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Connection: close Jun 14 18:31:36.516684 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Length: 74 Jun 14 18:31:36.516684 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Type: application/json Jun 14 18:31:36.516684 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Host: 10.222.0.78 Jun 14 18:31:36.516684 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Openstack-System-Scope: None Jun 14 18:31:36.516684 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: User-Agent: python-urllib3/1.26.9 Jun 14 18:31:36.516684 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Auth-Token: gAAAAABiqNNRwUW-ILUkPK_wgILFSFKwt3erUOv38mYIB0oCeDDiotO112_xIQykQF206CMg3446rqZisR6hzfab3579MeUncL30z5LdS-2pD1weLSQ2dqyxdVYPdVwx-jGbuP7Kwf2vbYNW1CdwMR0V5q1_4RRQAdNuD7UVUw8E8v9L5saJIsU Jun 14 18:31:36.516684 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Id: None Jun 14 18:31:36.516684 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Name: None Jun 14 18:31:36.516684 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Identity-Status: Confirmed Jun 14 18:31:36.516684 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Is-Admin-Project: True Jun 14 18:31:36.516684 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Id: default Jun 14 18:31:36.516684 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Name: Default Jun 14 18:31:36.516684 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Id: 56f8367a52044e82a2c272da39e1bfd8 Jun 14 18:31:36.516684 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Name: tempest-AttachVolumeNegativeTest-1598181014 Jun 14 18:31:36.516684 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Role: reader,member Jun 14 18:31:36.516684 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Roles: reader,member Jun 14 18:31:36.518063 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_56f8367a52044e82a2c272da39e1bfd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/56f8367a52044e82a2c272da39e1bfd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/56f8367a52044e82a2c272da39e1bfd8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/56f8367a52044e82a2c272da39e1bfd8"}]}] Jun 14 18:31:36.518063 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant: tempest-AttachVolumeNegativeTest-1598181014 Jun 14 18:31:36.518063 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Id: 56f8367a52044e82a2c272da39e1bfd8 Jun 14 18:31:36.518063 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1598181014 Jun 14 18:31:36.518063 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User: tempest-AttachVolumeNegativeTest-1598181014-project Jun 14 18:31:36.518063 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Id: default Jun 14 18:31:36.518063 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Name: Default Jun 14 18:31:36.518063 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Id: 9254bd46822346009497b01d28314335 Jun 14 18:31:36.518063 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Name: tempest-AttachVolumeNegativeTest-1598181014-project Jun 14 18:31:36.518063 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Jun 14 18:31:36.518063 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: {"volumeAttachment": {"volumeId": "2899039d-b3ca-488b-b808-026c69f98f82"}} Jun 14 18:31:36.518063 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: method: > Jun 14 18:31:36.518829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: exception: Invalid volume: volume 2899039d-b3ca-488b-b808-026c69f98f82 is already attached to instances: 17641e09-70b6-4020-9fb5-31780056f2d9 Jun 14 18:31:36.518829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: action_args: {'server_id': 'f1bbd826-8155-4a11-bba3-9a4b3172b726', 'body': {'volumeAttachment': {'volumeId': '2899039d-b3ca-488b-b808-026c69f98f82'}}} Jun 14 18:31:36.518829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:31:36.518829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:31:36.518829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 14 18:31:36.518829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 14 18:31:36.518829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 14 18:31:36.518829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 14 18:31:36.518829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 14 18:31:36.518829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 14 18:31:36.518829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 14 18:31:36.518829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 14 18:31:36.518829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 14 18:31:36.518829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 14 18:31:36.518829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2899039d-b3ca-488b-b808-026c69f98f82 is already attached to instances: 17641e09-70b6-4020-9fb5-31780056f2d9 Jun 14 18:31:36.518829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:31:36.518829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:31:36.518829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:31:36.518829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:31:36.520106 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:31:36.520106 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:31:36.520106 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:31:36.520106 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:31:36.520106 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:31:36.520106 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:31:36.520106 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 14 18:31:36.520106 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 14 18:31:36.520106 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 14 18:31:36.520106 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 14 18:31:36.520106 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 14 18:31:36.520106 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 14 18:31:36.520106 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 14 18:31:36.520106 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 14 18:31:36.520106 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2899039d-b3ca-488b-b808-026c69f98f82 is already attached to instances: 17641e09-70b6-4020-9fb5-31780056f2d9 Jun 14 18:31:36.520106 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:31:36.520106 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:31:36.520106 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:31:36.520106 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:31:36.520106 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:31:36.521530 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:31:36.521530 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:31:36.521530 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:31:36.521530 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2899039d-b3ca-488b-b808-026c69f98f82 is already attached to instances: 17641e09-70b6-4020-9fb5-31780056f2d9 Jun 14 18:31:36.521530 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:31:36.521530 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-241a70c7-b5e5-457f-a36e-20ae90e82769 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Returning 400 to user: Invalid volume: volume 2899039d-b3ca-488b-b808-026c69f98f82 is already attached to instances: 17641e09-70b6-4020-9fb5-31780056f2d9 {{(pid=118624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:31:36.521530 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-241a70c7-b5e5-457f-a36e-20ae90e82769 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "POST /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106249 Jun 14 18:31:36.521530 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 298/563] 10.222.0.78 () {60 vars in 1322 bytes} [Tue Jun 14 18:31:36 2022] POST /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 14 18:31:36.527561 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-7bf8489d-95ec-4fba-9fcd-fd74d3d82f01 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:36.528049 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-7bf8489d-95ec-4fba-9fcd-fd74d3d82f01 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:36.534284 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7bf8489d-95ec-4fba-9fcd-fd74d3d82f01 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:36.534728 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7bf8489d-95ec-4fba-9fcd-fd74d3d82f01 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:36.535483 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7bf8489d-95ec-4fba-9fcd-fd74d3d82f01 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:36.535912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7bf8489d-95ec-4fba-9fcd-fd74d3d82f01 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:36.561574 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-7bf8489d-95ec-4fba-9fcd-fd74d3d82f01 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Going to try to terminate instance {{(pid=118623) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:31:36.734584 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-36a73dcc-f101-4acf-8670-6de6dc28f7f2 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:36.735209 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-36a73dcc-f101-4acf-8670-6de6dc28f7f2 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:36.741592 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-36a73dcc-f101-4acf-8670-6de6dc28f7f2 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:36.742982 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-36a73dcc-f101-4acf-8670-6de6dc28f7f2 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:36.743802 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-36a73dcc-f101-4acf-8670-6de6dc28f7f2 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:36.744342 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-36a73dcc-f101-4acf-8670-6de6dc28f7f2 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:36.891039 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-7bf8489d-95ec-4fba-9fcd-fd74d3d82f01 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726" status: 204 len: 0 microversion: 2.1 time: 0.367516 Jun 14 18:31:36.891642 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 266/564] 10.222.0.78 () {58 vars in 1238 bytes} [Tue Jun 14 18:31:36 2022] DELETE /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 18:31:36.897118 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-ac4be9f9-08aa-4ddc-9ff3-2b25b8fbfd21 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:36.898875 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-36a73dcc-f101-4acf-8670-6de6dc28f7f2 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:36.899506 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-ac4be9f9-08aa-4ddc-9ff3-2b25b8fbfd21 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:36.906501 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ac4be9f9-08aa-4ddc-9ff3-2b25b8fbfd21 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:36.906946 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ac4be9f9-08aa-4ddc-9ff3-2b25b8fbfd21 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:36.907625 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-36a73dcc-f101-4acf-8670-6de6dc28f7f2 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1756 microversion: 2.1 time: 0.176900 Jun 14 18:31:36.907742 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ac4be9f9-08aa-4ddc-9ff3-2b25b8fbfd21 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:36.908136 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ac4be9f9-08aa-4ddc-9ff3-2b25b8fbfd21 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:36.908271 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 299/565] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:36 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:31:36.912826 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-81843eb3-b029-4ea3-9e21-41c594e0c804 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:36.913463 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-81843eb3-b029-4ea3-9e21-41c594e0c804 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:36.921216 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-81843eb3-b029-4ea3-9e21-41c594e0c804 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:36.921703 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-81843eb3-b029-4ea3-9e21-41c594e0c804 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:36.922503 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-81843eb3-b029-4ea3-9e21-41c594e0c804 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:36.922936 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-81843eb3-b029-4ea3-9e21-41c594e0c804 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:36.941436 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-ac4be9f9-08aa-4ddc-9ff3-2b25b8fbfd21 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048531 Jun 14 18:31:36.942045 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 267/566] 10.222.0.78 () {60 vars in 1342 bytes} [Tue Jun 14 18:31:36 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:37.015369 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-66fd1938-643c-4686-95c6-ead3a7b2539a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:37.016420 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-66fd1938-643c-4686-95c6-ead3a7b2539a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:37.022471 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-66fd1938-643c-4686-95c6-ead3a7b2539a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:37.022967 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-66fd1938-643c-4686-95c6-ead3a7b2539a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:37.023789 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-66fd1938-643c-4686-95c6-ead3a7b2539a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:37.024224 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-66fd1938-643c-4686-95c6-ead3a7b2539a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:37.053465 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-66fd1938-643c-4686-95c6-ead3a7b2539a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Going to try to terminate instance {{(pid=118623) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:31:37.068768 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-81843eb3-b029-4ea3-9e21-41c594e0c804 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:37.076833 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-81843eb3-b029-4ea3-9e21-41c594e0c804 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726" status: 200 len: 1681 microversion: 2.1 time: 0.167535 Jun 14 18:31:37.077663 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 300/567] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:36 2022] GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:37.374056 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-66fd1938-643c-4686-95c6-ead3a7b2539a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 204 len: 0 microversion: 2.20 time: 0.362176 Jun 14 18:31:37.374557 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 268/568] 10.222.0.78 () {60 vars in 1279 bytes} [Tue Jun 14 18:31:37 2022] DELETE /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 14 18:31:37.383016 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-79caa912-6f3d-4c73-b10f-d4c6272962a3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:37.383649 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-79caa912-6f3d-4c73-b10f-d4c6272962a3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:37.390069 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-79caa912-6f3d-4c73-b10f-d4c6272962a3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:37.390498 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-79caa912-6f3d-4c73-b10f-d4c6272962a3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:37.391266 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-79caa912-6f3d-4c73-b10f-d4c6272962a3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:37.391703 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-79caa912-6f3d-4c73-b10f-d4c6272962a3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:37.526037 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-79caa912-6f3d-4c73-b10f-d4c6272962a3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:37.533919 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-79caa912-6f3d-4c73-b10f-d4c6272962a3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:37.535424 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-79caa912-6f3d-4c73-b10f-d4c6272962a3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:37.537383 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-79caa912-6f3d-4c73-b10f-d4c6272962a3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1724 microversion: 2.20 time: 0.157587 Jun 14 18:31:37.537383 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 301/569] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:31:37 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:31:37.927027 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-27d9fc10-e45e-42ac-b0af-6a7dd57a6bf7 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:37.927732 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-27d9fc10-e45e-42ac-b0af-6a7dd57a6bf7 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:37.934667 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-27d9fc10-e45e-42ac-b0af-6a7dd57a6bf7 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:37.935114 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-27d9fc10-e45e-42ac-b0af-6a7dd57a6bf7 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:37.935882 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-27d9fc10-e45e-42ac-b0af-6a7dd57a6bf7 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:37.936308 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-27d9fc10-e45e-42ac-b0af-6a7dd57a6bf7 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:38.092101 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-27d9fc10-e45e-42ac-b0af-6a7dd57a6bf7 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:38.096418 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-0d28413e-8d39-41b8-aec6-9100b99c9581 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:38.097131 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-0d28413e-8d39-41b8-aec6-9100b99c9581 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:38.100459 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-27d9fc10-e45e-42ac-b0af-6a7dd57a6bf7 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1756 microversion: 2.1 time: 0.177587 Jun 14 18:31:38.101034 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 269/570] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:37 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:38.104775 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-0d28413e-8d39-41b8-aec6-9100b99c9581 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:38.105303 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-0d28413e-8d39-41b8-aec6-9100b99c9581 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:38.106162 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-0d28413e-8d39-41b8-aec6-9100b99c9581 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:38.106660 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-0d28413e-8d39-41b8-aec6-9100b99c9581 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:38.248020 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-0d28413e-8d39-41b8-aec6-9100b99c9581 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:38.255994 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-0d28413e-8d39-41b8-aec6-9100b99c9581 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726" status: 200 len: 1681 microversion: 2.1 time: 0.163383 Jun 14 18:31:38.256582 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 302/571] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:38 2022] GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:31:38.556504 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-b201c7fb-7c8e-498e-8426-3f625afc9c29 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:38.557007 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-b201c7fb-7c8e-498e-8426-3f625afc9c29 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:38.563508 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b201c7fb-7c8e-498e-8426-3f625afc9c29 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:38.563948 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b201c7fb-7c8e-498e-8426-3f625afc9c29 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:38.564704 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b201c7fb-7c8e-498e-8426-3f625afc9c29 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:38.565134 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b201c7fb-7c8e-498e-8426-3f625afc9c29 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:38.696870 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-b201c7fb-7c8e-498e-8426-3f625afc9c29 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:38.705407 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-b201c7fb-7c8e-498e-8426-3f625afc9c29 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:38.707051 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-b201c7fb-7c8e-498e-8426-3f625afc9c29 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:38.708251 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-b201c7fb-7c8e-498e-8426-3f625afc9c29 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1724 microversion: 2.20 time: 0.155852 Jun 14 18:31:38.708843 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 270/572] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:31:38 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:31:39.118781 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-490921a5-9e5b-4cac-ae19-105532de2410 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:39.119464 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-490921a5-9e5b-4cac-ae19-105532de2410 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:39.126118 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-490921a5-9e5b-4cac-ae19-105532de2410 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:39.127327 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-490921a5-9e5b-4cac-ae19-105532de2410 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:39.127327 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-490921a5-9e5b-4cac-ae19-105532de2410 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:39.127957 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-490921a5-9e5b-4cac-ae19-105532de2410 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:39.274853 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-12497cd1-dc02-457e-bb42-f6c8745a402a tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:39.275477 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-12497cd1-dc02-457e-bb42-f6c8745a402a tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:39.280394 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-490921a5-9e5b-4cac-ae19-105532de2410 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:39.282082 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-12497cd1-dc02-457e-bb42-f6c8745a402a tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:39.282541 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-12497cd1-dc02-457e-bb42-f6c8745a402a tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:39.283320 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-12497cd1-dc02-457e-bb42-f6c8745a402a tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:39.283759 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-12497cd1-dc02-457e-bb42-f6c8745a402a tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:39.289261 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-490921a5-9e5b-4cac-ae19-105532de2410 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1756 microversion: 2.1 time: 0.173942 Jun 14 18:31:39.290039 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 303/573] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:39 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:39.424320 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-12497cd1-dc02-457e-bb42-f6c8745a402a tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:39.432320 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-12497cd1-dc02-457e-bb42-f6c8745a402a tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726" status: 200 len: 1681 microversion: 2.1 time: 0.162291 Jun 14 18:31:39.432911 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 271/574] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:39 2022] GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:31:39.727884 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-6ca17e25-561a-4516-b842-3d866a373417 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:39.728498 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-6ca17e25-561a-4516-b842-3d866a373417 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:39.734937 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6ca17e25-561a-4516-b842-3d866a373417 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:39.735391 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6ca17e25-561a-4516-b842-3d866a373417 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:39.736163 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6ca17e25-561a-4516-b842-3d866a373417 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:39.736603 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6ca17e25-561a-4516-b842-3d866a373417 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:39.872541 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-6ca17e25-561a-4516-b842-3d866a373417 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:39.880651 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-6ca17e25-561a-4516-b842-3d866a373417 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:39.882213 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-6ca17e25-561a-4516-b842-3d866a373417 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:39.883767 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-6ca17e25-561a-4516-b842-3d866a373417 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1724 microversion: 2.20 time: 0.159974 Jun 14 18:31:39.884322 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 304/575] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:31:39 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:31:40.308042 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-a0d9359e-c617-4301-be0e-ec1433516b65 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:40.308696 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-a0d9359e-c617-4301-be0e-ec1433516b65 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:40.315729 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a0d9359e-c617-4301-be0e-ec1433516b65 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:40.316172 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a0d9359e-c617-4301-be0e-ec1433516b65 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:40.316936 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a0d9359e-c617-4301-be0e-ec1433516b65 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:40.317369 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a0d9359e-c617-4301-be0e-ec1433516b65 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:40.459000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-b1cf218e-12a9-4d3b-872c-d02a0df3b8a1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:40.459669 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-b1cf218e-12a9-4d3b-872c-d02a0df3b8a1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:40.467112 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b1cf218e-12a9-4d3b-872c-d02a0df3b8a1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:40.467584 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b1cf218e-12a9-4d3b-872c-d02a0df3b8a1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:40.468358 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b1cf218e-12a9-4d3b-872c-d02a0df3b8a1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:40.468790 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b1cf218e-12a9-4d3b-872c-d02a0df3b8a1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:40.471588 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-a0d9359e-c617-4301-be0e-ec1433516b65 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:40.480799 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-a0d9359e-c617-4301-be0e-ec1433516b65 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1759 microversion: 2.1 time: 0.176930 Jun 14 18:31:40.484263 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 272/576] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:40 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1759 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:31:40.607775 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-b1cf218e-12a9-4d3b-872c-d02a0df3b8a1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:40.616045 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-b1cf218e-12a9-4d3b-872c-d02a0df3b8a1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726" status: 200 len: 1681 microversion: 2.1 time: 0.160882 Jun 14 18:31:40.616627 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 305/577] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:40 2022] GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:40.903171 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-a24d66d3-31e5-4565-880b-40294383b528 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:40.905226 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-a24d66d3-31e5-4565-880b-40294383b528 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:40.910961 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a24d66d3-31e5-4565-880b-40294383b528 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:40.911580 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a24d66d3-31e5-4565-880b-40294383b528 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:40.912747 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a24d66d3-31e5-4565-880b-40294383b528 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:40.913600 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a24d66d3-31e5-4565-880b-40294383b528 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:41.072048 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-a24d66d3-31e5-4565-880b-40294383b528 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:41.082506 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-a24d66d3-31e5-4565-880b-40294383b528 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:41.085133 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-a24d66d3-31e5-4565-880b-40294383b528 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:41.086797 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-a24d66d3-31e5-4565-880b-40294383b528 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1724 microversion: 2.20 time: 0.188309 Jun 14 18:31:41.087653 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 273/578] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:31:40 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:31:41.635605 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-02edca4c-f00c-4379-8a74-5ca8e8eff8f6 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:41.636411 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-02edca4c-f00c-4379-8a74-5ca8e8eff8f6 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:41.643454 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-02edca4c-f00c-4379-8a74-5ca8e8eff8f6 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:41.643660 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-02edca4c-f00c-4379-8a74-5ca8e8eff8f6 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:41.644404 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-02edca4c-f00c-4379-8a74-5ca8e8eff8f6 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:41.644844 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-02edca4c-f00c-4379-8a74-5ca8e8eff8f6 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:41.907608 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-02edca4c-f00c-4379-8a74-5ca8e8eff8f6 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:41.915706 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-02edca4c-f00c-4379-8a74-5ca8e8eff8f6 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726" status: 200 len: 1681 microversion: 2.1 time: 0.284900 Jun 14 18:31:41.916296 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 306/579] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:41 2022] GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 => generated 1681 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:42.106443 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-d08d5875-71dd-41a0-8523-564116d7ba88 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:42.107320 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-d08d5875-71dd-41a0-8523-564116d7ba88 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:42.108941 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-851031db-0486-4ffd-aacd-5701962d2bea tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:42.110943 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-851031db-0486-4ffd-aacd-5701962d2bea tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:42.115948 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d08d5875-71dd-41a0-8523-564116d7ba88 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:42.116722 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d08d5875-71dd-41a0-8523-564116d7ba88 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:42.118486 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d08d5875-71dd-41a0-8523-564116d7ba88 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:42.118988 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d08d5875-71dd-41a0-8523-564116d7ba88 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:42.119127 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-851031db-0486-4ffd-aacd-5701962d2bea tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:42.119626 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-851031db-0486-4ffd-aacd-5701962d2bea tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:42.120416 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-851031db-0486-4ffd-aacd-5701962d2bea tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:42.120908 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-851031db-0486-4ffd-aacd-5701962d2bea tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:42.171771 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-851031db-0486-4ffd-aacd-5701962d2bea tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052837 Jun 14 18:31:42.171771 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 307/580] 10.222.0.78 () {58 vars in 1301 bytes} [Tue Jun 14 18:31:42 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 14 18:31:42.207638 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-d08d5875-71dd-41a0-8523-564116d7ba88 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:42.218218 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-d08d5875-71dd-41a0-8523-564116d7ba88 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:42.221057 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-d08d5875-71dd-41a0-8523-564116d7ba88 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:42.222291 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-d08d5875-71dd-41a0-8523-564116d7ba88 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1656 microversion: 2.20 time: 0.119992 Jun 14 18:31:42.223236 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 274/581] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:31:42 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1656 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:31:42.248969 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-fab2d7b5-0b78-4f62-9a05-467d9189ddc9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:42.249666 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-fab2d7b5-0b78-4f62-9a05-467d9189ddc9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:42.256588 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-fab2d7b5-0b78-4f62-9a05-467d9189ddc9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:42.257040 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-fab2d7b5-0b78-4f62-9a05-467d9189ddc9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:42.258199 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-fab2d7b5-0b78-4f62-9a05-467d9189ddc9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:42.258649 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-fab2d7b5-0b78-4f62-9a05-467d9189ddc9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:42.286609 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-fab2d7b5-0b78-4f62-9a05-467d9189ddc9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Going to try to terminate instance {{(pid=118624) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:31:42.615085 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-fab2d7b5-0b78-4f62-9a05-467d9189ddc9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "DELETE /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 204 len: 0 microversion: 2.1 time: 0.369684 Jun 14 18:31:42.615672 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 308/582] 10.222.0.78 () {58 vars in 1238 bytes} [Tue Jun 14 18:31:42 2022] DELETE /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 18:31:42.624139 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-144cc639-7087-4c98-b452-36037d3a1754 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:42.624747 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-144cc639-7087-4c98-b452-36037d3a1754 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:42.631849 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-144cc639-7087-4c98-b452-36037d3a1754 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:42.634414 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-144cc639-7087-4c98-b452-36037d3a1754 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:42.634742 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-144cc639-7087-4c98-b452-36037d3a1754 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:42.635194 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-144cc639-7087-4c98-b452-36037d3a1754 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:42.639927 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:31:42.793142 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-144cc639-7087-4c98-b452-36037d3a1754 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:42.803057 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-144cc639-7087-4c98-b452-36037d3a1754 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1674 microversion: 2.1 time: 0.182714 Jun 14 18:31:42.804294 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 275/583] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:42 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1674 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:42.822590 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-2f043e19-a8c4-4cfe-b117-e30883c47b74 req-125ec927-ea91-4522-9647-29327bfa869c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1bbd826-8155-4a11-bba3-9a4b3172b726", "name": "network-vif-deleted", "tag": "94648b79-8eac-456c-9ef4-94a9d6d3e060"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:31:42.841302 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-2f043e19-a8c4-4cfe-b117-e30883c47b74 req-125ec927-ea91-4522-9647-29327bfa869c service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:42.842298 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-2f043e19-a8c4-4cfe-b117-e30883c47b74 req-125ec927-ea91-4522-9647-29327bfa869c service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:42.858063 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-2f043e19-a8c4-4cfe-b117-e30883c47b74 req-125ec927-ea91-4522-9647-29327bfa869c service nova] Creating event network-vif-deleted:94648b79-8eac-456c-9ef4-94a9d6d3e060 for instance f1bbd826-8155-4a11-bba3-9a4b3172b726 on hv-cinder-84456 Jun 14 18:31:42.865870 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-2f043e19-a8c4-4cfe-b117-e30883c47b74 req-125ec927-ea91-4522-9647-29327bfa869c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045668 Jun 14 18:31:42.865870 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 309/584] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:31:42.932751 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-563c4742-acf7-4bb6-8c1c-fa03a14421f9 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:42.937485 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-563c4742-acf7-4bb6-8c1c-fa03a14421f9 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:42.953117 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-563c4742-acf7-4bb6-8c1c-fa03a14421f9 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:42.953705 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-563c4742-acf7-4bb6-8c1c-fa03a14421f9 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:42.954589 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-563c4742-acf7-4bb6-8c1c-fa03a14421f9 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:42.955101 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-563c4742-acf7-4bb6-8c1c-fa03a14421f9 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:43.037472 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-563c4742-acf7-4bb6-8c1c-fa03a14421f9 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:43.047433 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-563c4742-acf7-4bb6-8c1c-fa03a14421f9 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726" status: 200 len: 1613 microversion: 2.1 time: 0.118870 Jun 14 18:31:43.048377 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 276/585] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:42 2022] GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 => generated 1613 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:43.248513 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-268800f7-8996-41c9-b29c-d48a050ca9b6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:43.249483 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-268800f7-8996-41c9-b29c-d48a050ca9b6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:43.260758 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-268800f7-8996-41c9-b29c-d48a050ca9b6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:43.261701 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-268800f7-8996-41c9-b29c-d48a050ca9b6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:43.262501 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-268800f7-8996-41c9-b29c-d48a050ca9b6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:43.263261 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-268800f7-8996-41c9-b29c-d48a050ca9b6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:43.288792 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:31:43.349216 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-268800f7-8996-41c9-b29c-d48a050ca9b6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:43.362482 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-268800f7-8996-41c9-b29c-d48a050ca9b6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:43.378033 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-268800f7-8996-41c9-b29c-d48a050ca9b6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:43.378033 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-268800f7-8996-41c9-b29c-d48a050ca9b6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1656 microversion: 2.20 time: 0.125758 Jun 14 18:31:43.378033 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 310/586] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:31:43 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1656 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:31:43.821001 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-3198395f-2727-40b1-a421-445c4ca6826b tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:43.822055 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-3198395f-2727-40b1-a421-445c4ca6826b tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:43.828798 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3198395f-2727-40b1-a421-445c4ca6826b tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:43.829255 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3198395f-2727-40b1-a421-445c4ca6826b tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:43.830068 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3198395f-2727-40b1-a421-445c4ca6826b tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:43.830536 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3198395f-2727-40b1-a421-445c4ca6826b tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:43.995813 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-3198395f-2727-40b1-a421-445c4ca6826b tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:44.005098 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-3198395f-2727-40b1-a421-445c4ca6826b tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1674 microversion: 2.1 time: 0.188658 Jun 14 18:31:44.005708 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 277/587] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:43 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1674 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:44.064136 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-956d84ca-dc14-4147-9a88-8efd724bab09 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:44.064792 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-956d84ca-dc14-4147-9a88-8efd724bab09 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:44.072602 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-956d84ca-dc14-4147-9a88-8efd724bab09 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:44.073048 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-956d84ca-dc14-4147-9a88-8efd724bab09 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:44.074120 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-956d84ca-dc14-4147-9a88-8efd724bab09 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:44.074713 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-956d84ca-dc14-4147-9a88-8efd724bab09 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:44.146040 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-956d84ca-dc14-4147-9a88-8efd724bab09 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:44.155668 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-956d84ca-dc14-4147-9a88-8efd724bab09 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726" status: 200 len: 1613 microversion: 2.1 time: 0.095279 Jun 14 18:31:44.156553 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 311/588] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:44 2022] GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 => generated 1613 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:44.386685 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-7b03a2bc-5646-429b-84ce-6658f8fbdcdf tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:44.387271 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-7b03a2bc-5646-429b-84ce-6658f8fbdcdf tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:44.393990 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7b03a2bc-5646-429b-84ce-6658f8fbdcdf tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:44.394474 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7b03a2bc-5646-429b-84ce-6658f8fbdcdf tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:44.395237 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7b03a2bc-5646-429b-84ce-6658f8fbdcdf tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:44.395830 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7b03a2bc-5646-429b-84ce-6658f8fbdcdf tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:44.469637 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-7b03a2bc-5646-429b-84ce-6658f8fbdcdf tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:44.483349 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-7b03a2bc-5646-429b-84ce-6658f8fbdcdf tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:44.484884 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-7b03a2bc-5646-429b-84ce-6658f8fbdcdf tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:44.486212 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-7b03a2bc-5646-429b-84ce-6658f8fbdcdf tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1656 microversion: 2.20 time: 0.104660 Jun 14 18:31:44.486808 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 278/589] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:31:44 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1656 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:31:44.895324 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-265df770-18cc-4912-b6ac-2465a6ccd711 req-5cc18338-a2b9-4cd5-927f-3b8c3ead1ba5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2876875b-5dbe-4032-949a-3357292296a2", "name": "network-vif-deleted", "tag": "ee384335-560e-4f82-a137-0b23b61ff825"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:31:44.903773 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-265df770-18cc-4912-b6ac-2465a6ccd711 req-5cc18338-a2b9-4cd5-927f-3b8c3ead1ba5 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:44.904096 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-265df770-18cc-4912-b6ac-2465a6ccd711 req-5cc18338-a2b9-4cd5-927f-3b8c3ead1ba5 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:44.916981 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-265df770-18cc-4912-b6ac-2465a6ccd711 req-5cc18338-a2b9-4cd5-927f-3b8c3ead1ba5 service nova] Creating event network-vif-deleted:ee384335-560e-4f82-a137-0b23b61ff825 for instance 2876875b-5dbe-4032-949a-3357292296a2 on hv-cinder-84456 Jun 14 18:31:44.921982 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-265df770-18cc-4912-b6ac-2465a6ccd711 req-5cc18338-a2b9-4cd5-927f-3b8c3ead1ba5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030274 Jun 14 18:31:44.922587 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 312/590] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:31:45.023257 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-1b2d6e3d-201f-4cc1-9270-79c077543430 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:45.024018 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-1b2d6e3d-201f-4cc1-9270-79c077543430 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:45.030599 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1b2d6e3d-201f-4cc1-9270-79c077543430 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:45.031054 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1b2d6e3d-201f-4cc1-9270-79c077543430 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:45.031845 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1b2d6e3d-201f-4cc1-9270-79c077543430 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:45.032267 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1b2d6e3d-201f-4cc1-9270-79c077543430 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:45.175501 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-a98d46fd-4495-491b-abd2-6c79a33cf254 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:45.180816 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-a98d46fd-4495-491b-abd2-6c79a33cf254 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:45.184669 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-1b2d6e3d-201f-4cc1-9270-79c077543430 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:45.186452 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a98d46fd-4495-491b-abd2-6c79a33cf254 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:45.186907 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a98d46fd-4495-491b-abd2-6c79a33cf254 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:45.188023 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a98d46fd-4495-491b-abd2-6c79a33cf254 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:45.188685 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a98d46fd-4495-491b-abd2-6c79a33cf254 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:45.195422 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-1b2d6e3d-201f-4cc1-9270-79c077543430 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1674 microversion: 2.1 time: 0.176059 Jun 14 18:31:45.196884 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 279/591] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:45 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1674 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:45.236003 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a98d46fd-4495-491b-abd2-6c79a33cf254 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:45.236749 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a98d46fd-4495-491b-abd2-6c79a33cf254 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:45.237575 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.objects.instance [None req-a98d46fd-4495-491b-abd2-6c79a33cf254 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lazy-loading 'fault' on Instance uuid f1bbd826-8155-4a11-bba3-9a4b3172b726 {{(pid=118624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:31:45.298796 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-a98d46fd-4495-491b-abd2-6c79a33cf254 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:45.308185 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-a98d46fd-4495-491b-abd2-6c79a33cf254 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726" status: 200 len: 1331 microversion: 2.1 time: 0.137612 Jun 14 18:31:45.308776 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 313/592] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:45 2022] GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 => generated 1331 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:31:45.505001 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-0581b9a8-63e5-494e-a6f3-ecf2e4e9a2fb tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:45.506837 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-0581b9a8-63e5-494e-a6f3-ecf2e4e9a2fb tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:45.512588 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0581b9a8-63e5-494e-a6f3-ecf2e4e9a2fb tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:45.513001 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0581b9a8-63e5-494e-a6f3-ecf2e4e9a2fb tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:45.513827 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0581b9a8-63e5-494e-a6f3-ecf2e4e9a2fb tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:45.514415 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0581b9a8-63e5-494e-a6f3-ecf2e4e9a2fb tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:45.547871 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0581b9a8-63e5-494e-a6f3-ecf2e4e9a2fb tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:45.548304 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0581b9a8-63e5-494e-a6f3-ecf2e4e9a2fb tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:45.548751 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.objects.instance [None req-0581b9a8-63e5-494e-a6f3-ecf2e4e9a2fb tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lazy-loading 'fault' on Instance uuid 2876875b-5dbe-4032-949a-3357292296a2 {{(pid=118623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:31:45.611078 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-0581b9a8-63e5-494e-a6f3-ecf2e4e9a2fb tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:45.624494 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-0581b9a8-63e5-494e-a6f3-ecf2e4e9a2fb tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:45.638446 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-0581b9a8-63e5-494e-a6f3-ecf2e4e9a2fb tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:45.640772 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-0581b9a8-63e5-494e-a6f3-ecf2e4e9a2fb tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 200 len: 1370 microversion: 2.20 time: 0.139981 Jun 14 18:31:45.651863 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 280/593] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:31:45 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 1370 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:31:46.214507 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-5c4c37c4-cf9a-41f9-a320-60ac9b10b6cf tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:46.215374 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-5c4c37c4-cf9a-41f9-a320-60ac9b10b6cf tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:46.222097 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5c4c37c4-cf9a-41f9-a320-60ac9b10b6cf tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:46.222613 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5c4c37c4-cf9a-41f9-a320-60ac9b10b6cf tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:46.223383 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5c4c37c4-cf9a-41f9-a320-60ac9b10b6cf tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:46.223818 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5c4c37c4-cf9a-41f9-a320-60ac9b10b6cf tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:46.256148 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5c4c37c4-cf9a-41f9-a320-60ac9b10b6cf tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:46.256633 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5c4c37c4-cf9a-41f9-a320-60ac9b10b6cf tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:46.257049 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.objects.instance [None req-5c4c37c4-cf9a-41f9-a320-60ac9b10b6cf tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lazy-loading 'fault' on Instance uuid 90a63d77-87d7-4616-af3d-fe6cb12e93fe {{(pid=118624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:31:46.302359 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-5c4c37c4-cf9a-41f9-a320-60ac9b10b6cf tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:46.310506 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-5c4c37c4-cf9a-41f9-a320-60ac9b10b6cf tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 200 len: 1328 microversion: 2.1 time: 0.100646 Jun 14 18:31:46.311098 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 314/594] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:46 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 1328 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:46.326353 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-0a17242f-a21f-40b8-9bbf-b81f450db268 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:46.326966 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-0a17242f-a21f-40b8-9bbf-b81f450db268 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:46.333610 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0a17242f-a21f-40b8-9bbf-b81f450db268 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:46.334062 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0a17242f-a21f-40b8-9bbf-b81f450db268 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:46.334839 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0a17242f-a21f-40b8-9bbf-b81f450db268 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:46.335270 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0a17242f-a21f-40b8-9bbf-b81f450db268 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:46.358497 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.wsgi [None req-0a17242f-a21f-40b8-9bbf-b81f450db268 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] HTTP exception thrown: Instance f1bbd826-8155-4a11-bba3-9a4b3172b726 could not be found. Jun 14 18:31:46.361860 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-0a17242f-a21f-40b8-9bbf-b81f450db268 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Request method failure captured: Jun 14 18:31:46.361860 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: request: GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 HTTP/1.1 Jun 14 18:31:46.361860 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept: application/json Jun 14 18:31:46.361860 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept-Encoding: identity Jun 14 18:31:46.361860 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Connection: close Jun 14 18:31:46.361860 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Length: 0 Jun 14 18:31:46.361860 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Type: application/json Jun 14 18:31:46.361860 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Host: 10.222.0.78 Jun 14 18:31:46.361860 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Openstack-System-Scope: None Jun 14 18:31:46.361860 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: User-Agent: python-urllib3/1.26.9 Jun 14 18:31:46.361860 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Auth-Token: gAAAAABiqNNRwUW-ILUkPK_wgILFSFKwt3erUOv38mYIB0oCeDDiotO112_xIQykQF206CMg3446rqZisR6hzfab3579MeUncL30z5LdS-2pD1weLSQ2dqyxdVYPdVwx-jGbuP7Kwf2vbYNW1CdwMR0V5q1_4RRQAdNuD7UVUw8E8v9L5saJIsU Jun 14 18:31:46.361860 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Id: None Jun 14 18:31:46.361860 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Name: None Jun 14 18:31:46.361860 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Identity-Status: Confirmed Jun 14 18:31:46.361860 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Is-Admin-Project: True Jun 14 18:31:46.361860 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Id: default Jun 14 18:31:46.361860 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Name: Default Jun 14 18:31:46.361860 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Id: 56f8367a52044e82a2c272da39e1bfd8 Jun 14 18:31:46.361860 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Name: tempest-AttachVolumeNegativeTest-1598181014 Jun 14 18:31:46.361860 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Role: reader,member Jun 14 18:31:46.361860 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Roles: reader,member Jun 14 18:31:46.363471 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_56f8367a52044e82a2c272da39e1bfd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/56f8367a52044e82a2c272da39e1bfd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/56f8367a52044e82a2c272da39e1bfd8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/56f8367a52044e82a2c272da39e1bfd8"}]}] Jun 14 18:31:46.363471 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant: tempest-AttachVolumeNegativeTest-1598181014 Jun 14 18:31:46.363471 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Id: 56f8367a52044e82a2c272da39e1bfd8 Jun 14 18:31:46.363471 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1598181014 Jun 14 18:31:46.363471 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User: tempest-AttachVolumeNegativeTest-1598181014-project Jun 14 18:31:46.363471 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Id: default Jun 14 18:31:46.363471 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Name: Default Jun 14 18:31:46.363471 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Id: 9254bd46822346009497b01d28314335 Jun 14 18:31:46.363471 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Name: tempest-AttachVolumeNegativeTest-1598181014-project Jun 14 18:31:46.363471 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: method: > Jun 14 18:31:46.363471 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: exception: Instance f1bbd826-8155-4a11-bba3-9a4b3172b726 could not be found. Jun 14 18:31:46.363471 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: action_args: {'id': 'f1bbd826-8155-4a11-bba3-9a4b3172b726'} Jun 14 18:31:46.364678 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:31:46.364678 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:31:46.364678 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:31:46.364678 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:31:46.364678 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:31:46.364678 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:31:46.364678 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:31:46.364678 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:31:46.364678 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:31:46.364678 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:31:46.364678 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1bbd826-8155-4a11-bba3-9a4b3172b726 could not be found. Jun 14 18:31:46.364678 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:31:46.364678 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:31:46.364678 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:31:46.364678 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:31:46.364678 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:31:46.364678 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:31:46.364678 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:31:46.364678 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:31:46.364678 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:31:46.366050 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:31:46.366050 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:31:46.366050 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:31:46.366050 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:31:46.366050 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:31:46.366050 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:31:46.366050 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:31:46.366050 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1bbd826-8155-4a11-bba3-9a4b3172b726 could not be found. Jun 14 18:31:46.366050 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:31:46.366050 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:31:46.366050 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:31:46.366050 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:31:46.366050 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:31:46.366050 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:31:46.366050 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:31:46.366050 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:31:46.366050 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1bbd826-8155-4a11-bba3-9a4b3172b726 could not be found. Jun 14 18:31:46.366050 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:31:46.369243 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-0a17242f-a21f-40b8-9bbf-b81f450db268 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Returning 404 to user: Instance f1bbd826-8155-4a11-bba3-9a4b3172b726 could not be found. {{(pid=118623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:31:46.369243 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-0a17242f-a21f-40b8-9bbf-b81f450db268 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726" status: 404 len: 111 microversion: 2.1 time: 0.041725 Jun 14 18:31:46.369243 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 281/595] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:46 2022] GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:31:46.374103 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-d54a69af-5ac2-4045-86d3-b4852be1ebf2 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '.version_select at 0x7efe70188d30>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:46.455192 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-d54a69af-5ac2-4045-86d3-b4852be1ebf2 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1881070328" status: 202 len: 0 microversion: 2.1 time: 0.084818 Jun 14 18:31:46.455780 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 315/596] 10.222.0.78 () {58 vars in 1220 bytes} [Tue Jun 14 18:31:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1881070328 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:31:46.660483 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-27d28f1e-8d69-4cc9-9f6b-581f9d223c96 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:46.661091 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-27d28f1e-8d69-4cc9-9f6b-581f9d223c96 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:46.668239 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-27d28f1e-8d69-4cc9-9f6b-581f9d223c96 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:46.668979 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-27d28f1e-8d69-4cc9-9f6b-581f9d223c96 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:46.669929 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-27d28f1e-8d69-4cc9-9f6b-581f9d223c96 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:46.670496 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-27d28f1e-8d69-4cc9-9f6b-581f9d223c96 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:46.689419 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.wsgi [None req-27d28f1e-8d69-4cc9-9f6b-581f9d223c96 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] HTTP exception thrown: Instance 2876875b-5dbe-4032-949a-3357292296a2 could not be found. Jun 14 18:31:46.691284 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-27d28f1e-8d69-4cc9-9f6b-581f9d223c96 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Request method failure captured: Jun 14 18:31:46.691284 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: request: GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 HTTP/1.1 Jun 14 18:31:46.691284 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept: application/json Jun 14 18:31:46.691284 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept-Encoding: identity Jun 14 18:31:46.691284 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Connection: close Jun 14 18:31:46.691284 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Length: 0 Jun 14 18:31:46.691284 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Type: application/json Jun 14 18:31:46.691284 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Host: 10.222.0.78 Jun 14 18:31:46.691284 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Openstack-System-Scope: None Jun 14 18:31:46.691284 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: User-Agent: python-urllib3/1.26.9 Jun 14 18:31:46.691284 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Auth-Token: gAAAAABiqNMFJuicSA_x3LAwtlTtL0woYIYWPVyzRBuu2w3gIFz8zwkFCJVgYXMmymY6Og8Q-JCquDKlggQ9BBzvZMZGA1Cg_iP1ACfiqqk9tEBoFtdzgUZok99MmOP28xoQ8P2eYjOVjHuIg3g70dWaiW6WYAMhzP1q7mnjqOrn3stEWOIBfsk Jun 14 18:31:46.691284 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Id: None Jun 14 18:31:46.691284 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Name: None Jun 14 18:31:46.691284 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Identity-Status: Confirmed Jun 14 18:31:46.691284 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Is-Admin-Project: True Jun 14 18:31:46.691284 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Openstack-Nova-Api-Version: 2.20 Jun 14 18:31:46.691284 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Id: default Jun 14 18:31:46.691284 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Name: Default Jun 14 18:31:46.691284 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Id: e8603a3b1604479da86224c52c2467ad Jun 14 18:31:46.691284 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-993386760 Jun 14 18:31:46.691284 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Role: reader,member Jun 14 18:31:46.691284 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Roles: reader,member Jun 14 18:31:46.692777 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e8603a3b1604479da86224c52c2467ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e8603a3b1604479da86224c52c2467ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e8603a3b1604479da86224c52c2467ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e8603a3b1604479da86224c52c2467ad"}]}] Jun 14 18:31:46.692777 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant: tempest-AttachVolumeShelveTestJSON-993386760 Jun 14 18:31:46.692777 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Id: e8603a3b1604479da86224c52c2467ad Jun 14 18:31:46.692777 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-993386760 Jun 14 18:31:46.692777 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User: tempest-AttachVolumeShelveTestJSON-993386760-project Jun 14 18:31:46.692777 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Id: default Jun 14 18:31:46.692777 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Name: Default Jun 14 18:31:46.692777 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Id: 76baaf45903d4c53ab3e0fe459b228ea Jun 14 18:31:46.692777 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Name: tempest-AttachVolumeShelveTestJSON-993386760-project Jun 14 18:31:46.692777 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: method: > Jun 14 18:31:46.692777 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: exception: Instance 2876875b-5dbe-4032-949a-3357292296a2 could not be found. Jun 14 18:31:46.692777 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: action_args: {'id': '2876875b-5dbe-4032-949a-3357292296a2'} Jun 14 18:31:46.693672 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:31:46.693672 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:31:46.693672 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:31:46.693672 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:31:46.693672 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:31:46.693672 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:31:46.693672 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:31:46.693672 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:31:46.693672 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:31:46.693672 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:31:46.693672 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2876875b-5dbe-4032-949a-3357292296a2 could not be found. Jun 14 18:31:46.693672 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:31:46.693672 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:31:46.693672 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:31:46.693672 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:31:46.693672 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:31:46.693672 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:31:46.693672 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:31:46.693672 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:31:46.693672 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:31:46.695902 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:31:46.695902 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:31:46.695902 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:31:46.695902 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:31:46.695902 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:31:46.695902 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:31:46.695902 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:31:46.695902 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2876875b-5dbe-4032-949a-3357292296a2 could not be found. Jun 14 18:31:46.695902 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:31:46.695902 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:31:46.695902 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:31:46.695902 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:31:46.695902 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:31:46.695902 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:31:46.695902 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:31:46.695902 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:31:46.695902 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2876875b-5dbe-4032-949a-3357292296a2 could not be found. Jun 14 18:31:46.695902 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:31:46.698017 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-27d28f1e-8d69-4cc9-9f6b-581f9d223c96 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Returning 404 to user: Instance 2876875b-5dbe-4032-949a-3357292296a2 could not be found. {{(pid=118623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:31:46.699060 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-27d28f1e-8d69-4cc9-9f6b-581f9d223c96 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 404 len: 111 microversion: 2.20 time: 0.042784 Jun 14 18:31:46.703516 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 282/597] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:31:46 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 14 18:31:46.710322 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-d885260f-7d61-4559-b704-8db11a66520f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '.version_select at 0x7efe702243a0>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:46.845224 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-d885260f-7d61-4559-b704-8db11a66520f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-724170124" status: 204 len: 0 microversion: 2.20 time: 0.140277 Jun 14 18:31:46.846488 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 316/598] 10.222.0.78 () {60 vars in 1258 bytes} [Tue Jun 14 18:31:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-724170124 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 14 18:31:46.965714 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-dd40ddb5-4990-4331-bebb-6a5686aa47e7 req-654392e8-81d8-45f3-8556-cd9c19fd2d84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90a63d77-87d7-4616-af3d-fe6cb12e93fe", "name": "network-vif-deleted", "tag": "7513d78b-6877-4846-a318-fbe800a362f4"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:31:46.997742 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-dd40ddb5-4990-4331-bebb-6a5686aa47e7 req-654392e8-81d8-45f3-8556-cd9c19fd2d84 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:46.998565 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-dd40ddb5-4990-4331-bebb-6a5686aa47e7 req-654392e8-81d8-45f3-8556-cd9c19fd2d84 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:47.021070 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-dd40ddb5-4990-4331-bebb-6a5686aa47e7 req-654392e8-81d8-45f3-8556-cd9c19fd2d84 service nova] Creating event network-vif-deleted:7513d78b-6877-4846-a318-fbe800a362f4 for instance 90a63d77-87d7-4616-af3d-fe6cb12e93fe on hv-cinder-84456 Jun 14 18:31:47.032094 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-dd40ddb5-4990-4331-bebb-6a5686aa47e7 req-654392e8-81d8-45f3-8556-cd9c19fd2d84 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071810 Jun 14 18:31:47.037314 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 283/599] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:31:47.329064 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-4f286215-ffbd-4e3f-ae5b-bc7c4aecefee tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:47.329869 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-4f286215-ffbd-4e3f-ae5b-bc7c4aecefee tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:47.336628 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4f286215-ffbd-4e3f-ae5b-bc7c4aecefee tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:47.337068 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4f286215-ffbd-4e3f-ae5b-bc7c4aecefee tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:47.337882 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4f286215-ffbd-4e3f-ae5b-bc7c4aecefee tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:47.338367 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4f286215-ffbd-4e3f-ae5b-bc7c4aecefee tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:47.352085 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.wsgi [None req-4f286215-ffbd-4e3f-ae5b-bc7c4aecefee tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] HTTP exception thrown: Instance 90a63d77-87d7-4616-af3d-fe6cb12e93fe could not be found. Jun 14 18:31:47.353767 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-4f286215-ffbd-4e3f-ae5b-bc7c4aecefee tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Request method failure captured: Jun 14 18:31:47.353767 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: request: GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe HTTP/1.1 Jun 14 18:31:47.353767 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept: application/json Jun 14 18:31:47.353767 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept-Encoding: identity Jun 14 18:31:47.353767 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Connection: close Jun 14 18:31:47.353767 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Length: 0 Jun 14 18:31:47.353767 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Type: application/json Jun 14 18:31:47.353767 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Host: 10.222.0.78 Jun 14 18:31:47.353767 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Openstack-System-Scope: None Jun 14 18:31:47.353767 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: User-Agent: python-urllib3/1.26.9 Jun 14 18:31:47.353767 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Auth-Token: gAAAAABiqNMP73XxprlGzNGbl2RRuxWxEeCnCyKOJesfEu2WL6zaFGYBG9DdxnVa9hDwyFtLBWjvTOBXMs2p5ZW_MV0Ak23jnUYR_d8O-hYGniwqFYgb3f35NWBTKNyIJC_YvLU72CIFRGkaxVcO159IMBIja5NUJPoz16EB4IP7ThRSyLD9mFA Jun 14 18:31:47.353767 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Id: None Jun 14 18:31:47.353767 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Name: None Jun 14 18:31:47.353767 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Identity-Status: Confirmed Jun 14 18:31:47.353767 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Is-Admin-Project: True Jun 14 18:31:47.353767 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Id: default Jun 14 18:31:47.353767 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Name: Default Jun 14 18:31:47.353767 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Id: e2f771a602054b349adae092a9d3ed24 Jun 14 18:31:47.353767 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Name: tempest-AttachVolumeTestJSON-1453686410 Jun 14 18:31:47.353767 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Role: reader,member Jun 14 18:31:47.353767 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Roles: reader,member Jun 14 18:31:47.355322 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e2f771a602054b349adae092a9d3ed24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e2f771a602054b349adae092a9d3ed24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e2f771a602054b349adae092a9d3ed24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e2f771a602054b349adae092a9d3ed24"}]}] Jun 14 18:31:47.355322 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant: tempest-AttachVolumeTestJSON-1453686410 Jun 14 18:31:47.355322 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Id: e2f771a602054b349adae092a9d3ed24 Jun 14 18:31:47.355322 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1453686410 Jun 14 18:31:47.355322 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User: tempest-AttachVolumeTestJSON-1453686410-project Jun 14 18:31:47.355322 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Id: default Jun 14 18:31:47.355322 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Name: Default Jun 14 18:31:47.355322 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Id: 922fd1f30c7647fdb19f8f67a39223cc Jun 14 18:31:47.355322 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Name: tempest-AttachVolumeTestJSON-1453686410-project Jun 14 18:31:47.355322 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: method: > Jun 14 18:31:47.355322 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: exception: Instance 90a63d77-87d7-4616-af3d-fe6cb12e93fe could not be found. Jun 14 18:31:47.355322 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: action_args: {'id': '90a63d77-87d7-4616-af3d-fe6cb12e93fe'} Jun 14 18:31:47.356304 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:31:47.356304 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:31:47.356304 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:31:47.356304 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:31:47.356304 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:31:47.356304 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:31:47.356304 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:31:47.356304 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:31:47.356304 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:31:47.356304 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:31:47.356304 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90a63d77-87d7-4616-af3d-fe6cb12e93fe could not be found. Jun 14 18:31:47.356304 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:31:47.356304 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:31:47.356304 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:31:47.356304 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:31:47.356304 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:31:47.356304 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:31:47.356304 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:31:47.356304 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:31:47.356304 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:31:47.357713 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:31:47.357713 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:31:47.357713 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:31:47.357713 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:31:47.357713 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:31:47.357713 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:31:47.357713 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:31:47.357713 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90a63d77-87d7-4616-af3d-fe6cb12e93fe could not be found. Jun 14 18:31:47.357713 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:31:47.357713 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:31:47.357713 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:31:47.357713 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:31:47.357713 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:31:47.357713 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:31:47.357713 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:31:47.357713 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:31:47.357713 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90a63d77-87d7-4616-af3d-fe6cb12e93fe could not be found. Jun 14 18:31:47.357713 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:31:47.358836 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-4f286215-ffbd-4e3f-ae5b-bc7c4aecefee tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Returning 404 to user: Instance 90a63d77-87d7-4616-af3d-fe6cb12e93fe could not be found. {{(pid=118624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:31:47.358836 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-4f286215-ffbd-4e3f-ae5b-bc7c4aecefee tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 404 len: 111 microversion: 2.1 time: 0.030839 Jun 14 18:31:47.358836 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 317/600] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:47 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 14 18:31:47.364990 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-a358b317-c360-49e0-a918-62065ffa76c5 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '.version_select at 0x7efe70bc0310>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:47.464188 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-a358b317-c360-49e0-a918-62065ffa76c5 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1626601001" status: 202 len: 0 microversion: 2.1 time: 0.103286 Jun 14 18:31:47.464894 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 284/601] 10.222.0.78 () {58 vars in 1220 bytes} [Tue Jun 14 18:31:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1626601001 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:31:47.644477 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-af0e8cd2-763c-4e73-9ac6-4e956594c020 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:47.644968 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-af0e8cd2-763c-4e73-9ac6-4e956594c020 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 17641e09-70b6-4020-9fb5-31780056f2d9] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:47.651588 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-af0e8cd2-763c-4e73-9ac6-4e956594c020 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:47.652011 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-af0e8cd2-763c-4e73-9ac6-4e956594c020 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:47.652817 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-af0e8cd2-763c-4e73-9ac6-4e956594c020 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:47.653254 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-af0e8cd2-763c-4e73-9ac6-4e956594c020 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:47.746755 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.objects.instance [None req-af0e8cd2-763c-4e73-9ac6-4e956594c020 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lazy-loading 'services' on Instance uuid 17641e09-70b6-4020-9fb5-31780056f2d9 {{(pid=118624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:31:47.863578 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-4d4996eb-f672-4044-abd7-97525ce2648a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Action: 'create', calling method: .version_select at 0x7efe70c39b80>, body: {"keypair": {"name": "tempest-keypair-1222989990", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7MX+gqXwCV7ZinTo88LvAfTitOZlne89Ah6SasaHhvJZ3YwEc2BEF+SgwFsVdJsaIkpr6orSun/rl/VL+UDtBIQV5im6EnUm4e3F1mskiU+FjLsuD5AwrQoOzgUj3Y5g=="}} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:31:47.878304 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.quota [None req-4d4996eb-f672-4044-abd7-97525ce2648a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Getting quotas for project e8603a3b1604479da86224c52c2467ad. Resources: {'key_pairs'} {{(pid=118623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:31:47.883328 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.quota [None req-4d4996eb-f672-4044-abd7-97525ce2648a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Getting quotas for user 76baaf45903d4c53ab3e0fe459b228ea and project e8603a3b1604479da86224c52c2467ad. Resources: {'key_pairs'} {{(pid=118623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:31:48.002986 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-4d4996eb-f672-4044-abd7-97525ce2648a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.143194 Jun 14 18:31:48.003754 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 285/602] 10.222.0.78 () {62 vars in 1199 bytes} [Tue Jun 14 18:31:47 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 145 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 14 18:31:48.110943 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-af0e8cd2-763c-4e73-9ac6-4e956594c020 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "DELETE /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9/os-volume_attachments/2899039d-b3ca-488b-b808-026c69f98f82" status: 202 len: 0 microversion: 2.1 time: 0.469923 Jun 14 18:31:48.111600 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 318/603] 10.222.0.78 () {58 vars in 1415 bytes} [Tue Jun 14 18:31:47 2022] DELETE /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9/os-volume_attachments/2899039d-b3ca-488b-b808-026c69f98f82 => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 14 18:31:48.120764 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-d2011e68-1e94-49c9-9228-3da68e95726f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:48.122096 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-d2011e68-1e94-49c9-9228-3da68e95726f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 17641e09-70b6-4020-9fb5-31780056f2d9] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:48.129122 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d2011e68-1e94-49c9-9228-3da68e95726f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:48.129594 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d2011e68-1e94-49c9-9228-3da68e95726f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:48.130365 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d2011e68-1e94-49c9-9228-3da68e95726f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:48.130795 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d2011e68-1e94-49c9-9228-3da68e95726f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:48.161486 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-d2011e68-1e94-49c9-9228-3da68e95726f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045031 Jun 14 18:31:48.162057 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 286/604] 10.222.0.78 () {58 vars in 1301 bytes} [Tue Jun 14 18:31:48 2022] GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:31:48.326468 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-a78d0500-5437-48c2-b517-053f42e9ccb6 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Action: 'create', calling method: .version_select at 0x7efe70153dc0>, body: {"keypair": {"name": "tempest-keypair-1046940498", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFCzB3h/x1pPOyLCnZdL+20mexRHUFJXUF6vIhuFV8l49IKAjxwQGJ2oVffglvlyziZYTVAW5PSzvt0cgYav/XgpVHGj/7IZSqHdTVHgcWfI1qu6h7SmspnhQeS/GkH3g=="}} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:31:48.344084 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.quota [None req-a78d0500-5437-48c2-b517-053f42e9ccb6 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Getting quotas for project e2f771a602054b349adae092a9d3ed24. Resources: {'key_pairs'} {{(pid=118624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:31:48.348684 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.quota [None req-a78d0500-5437-48c2-b517-053f42e9ccb6 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Getting quotas for user 922fd1f30c7647fdb19f8f67a39223cc and project e2f771a602054b349adae092a9d3ed24. Resources: {'key_pairs'} {{(pid=118624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:31:48.467260 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-a78d0500-5437-48c2-b517-053f42e9ccb6 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.144998 Jun 14 18:31:48.467884 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 319/605] 10.222.0.78 () {60 vars in 1158 bytes} [Tue Jun 14 18:31:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:31:49.173069 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-15130b35-0c9e-4043-8c05-82ec4dff65b7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:49.174172 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-15130b35-0c9e-4043-8c05-82ec4dff65b7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 17641e09-70b6-4020-9fb5-31780056f2d9] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:49.181509 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-15130b35-0c9e-4043-8c05-82ec4dff65b7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:49.182187 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-15130b35-0c9e-4043-8c05-82ec4dff65b7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:49.183067 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-15130b35-0c9e-4043-8c05-82ec4dff65b7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:49.183473 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-15130b35-0c9e-4043-8c05-82ec4dff65b7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:49.213219 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-15130b35-0c9e-4043-8c05-82ec4dff65b7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044291 Jun 14 18:31:49.217111 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 287/606] 10.222.0.78 () {58 vars in 1301 bytes} [Tue Jun 14 18:31:49 2022] GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:31:50.225120 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-618d4c50-2665-4aa9-be2b-d8dadbdee5fa tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:50.226946 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-618d4c50-2665-4aa9-be2b-d8dadbdee5fa tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 17641e09-70b6-4020-9fb5-31780056f2d9] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:50.233807 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-618d4c50-2665-4aa9-be2b-d8dadbdee5fa tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:50.234287 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-618d4c50-2665-4aa9-be2b-d8dadbdee5fa tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:50.235057 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-618d4c50-2665-4aa9-be2b-d8dadbdee5fa tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:50.235562 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-618d4c50-2665-4aa9-be2b-d8dadbdee5fa tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:50.266604 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-618d4c50-2665-4aa9-be2b-d8dadbdee5fa tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046186 Jun 14 18:31:50.267187 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 320/607] 10.222.0.78 () {58 vars in 1301 bytes} [Tue Jun 14 18:31:50 2022] GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 14 18:31:50.341073 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-1a09666d-8550-46c6-846d-8942bf11d0dc tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:50.341929 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-1a09666d-8550-46c6-846d-8942bf11d0dc tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 17641e09-70b6-4020-9fb5-31780056f2d9] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:50.345477 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:31:50.349030 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1a09666d-8550-46c6-846d-8942bf11d0dc tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:50.349494 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1a09666d-8550-46c6-846d-8942bf11d0dc tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:50.350269 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1a09666d-8550-46c6-846d-8942bf11d0dc tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:50.350705 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1a09666d-8550-46c6-846d-8942bf11d0dc tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:50.377652 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-1a09666d-8550-46c6-846d-8942bf11d0dc tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 17641e09-70b6-4020-9fb5-31780056f2d9] Going to try to terminate instance {{(pid=118623) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:31:50.706051 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-1a09666d-8550-46c6-846d-8942bf11d0dc tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "DELETE /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9" status: 204 len: 0 microversion: 2.1 time: 0.368789 Jun 14 18:31:50.707026 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 288/608] 10.222.0.78 () {58 vars in 1238 bytes} [Tue Jun 14 18:31:50 2022] DELETE /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 18:31:50.716295 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-83631eeb-7b7b-4c39-950a-7a622c087a74 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:50.718867 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-83631eeb-7b7b-4c39-950a-7a622c087a74 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 17641e09-70b6-4020-9fb5-31780056f2d9] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:50.724553 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-83631eeb-7b7b-4c39-950a-7a622c087a74 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:50.725102 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-83631eeb-7b7b-4c39-950a-7a622c087a74 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:50.725926 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-83631eeb-7b7b-4c39-950a-7a622c087a74 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:50.727424 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-83631eeb-7b7b-4c39-950a-7a622c087a74 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:50.944234 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-83631eeb-7b7b-4c39-950a-7a622c087a74 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:50.953005 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-83631eeb-7b7b-4c39-950a-7a622c087a74 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9" status: 200 len: 1680 microversion: 2.1 time: 0.240787 Jun 14 18:31:50.955220 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 321/609] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:50 2022] GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9 => generated 1680 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:51.030810 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-ea105a96-999c-4a1c-81e4-deab09bb3886 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1403101492", "imageRef": "e2555120-8576-4128-944f-40805aa95a9b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "274ef244-b114-4d41-92b0-e6c757fabfee"}], "security_groups": [{"name": "tempest-securitygroup--346497408"}], "key_name": "tempest-keypair-1222989990", "user_data": "}} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:31:51.139488 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.network.neutron [None req-ea105a96-999c-4a1c-81e4-deab09bb3886 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] validate_networks() for [('274ef244-b114-4d41-92b0-e6c757fabfee', None, None, None, None, None)] {{(pid=118623) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 18:31:51.534070 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-ea105a96-999c-4a1c-81e4-deab09bb3886 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Flavor limits 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 18:31:51.534664 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-ea105a96-999c-4a1c-81e4-deab09bb3886 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Image limits 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 18:31:51.535154 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-ea105a96-999c-4a1c-81e4-deab09bb3886 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Flavor pref 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 18:31:51.535633 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-ea105a96-999c-4a1c-81e4-deab09bb3886 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Image pref 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 18:31:51.536119 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-ea105a96-999c-4a1c-81e4-deab09bb3886 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 18:31:51.547018 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ea105a96-999c-4a1c-81e4-deab09bb3886 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:51.547861 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ea105a96-999c-4a1c-81e4-deab09bb3886 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:51.548436 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ea105a96-999c-4a1c-81e4-deab09bb3886 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:51.548874 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ea105a96-999c-4a1c-81e4-deab09bb3886 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:51.562973 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-32d6ff6b-9128-4cae-a991-104d4c2fe7fc tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-733982091", "imageRef": "e2555120-8576-4128-944f-40805aa95a9b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c02f9f85-b95f-4513-a67b-ed0864c5046e"}], "security_groups": [{"name": "tempest-securitygroup--1728338088"}], "key_name": "tempest-keypair-1046940498", "user_data": "}} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:31:51.566929 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.quota [None req-ea105a96-999c-4a1c-81e4-deab09bb3886 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Getting quotas for project e8603a3b1604479da86224c52c2467ad. Resources: {'instances', 'cores', 'ram'} {{(pid=118623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:31:51.571115 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.quota [None req-ea105a96-999c-4a1c-81e4-deab09bb3886 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Getting quotas for user 76baaf45903d4c53ab3e0fe459b228ea and project e8603a3b1604479da86224c52c2467ad. Resources: {'instances', 'cores', 'ram'} {{(pid=118623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:31:51.582449 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-ea105a96-999c-4a1c-81e4-deab09bb3886 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Going to run 1 instances... {{(pid=118623) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 18:31:51.584785 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-ea105a96-999c-4a1c-81e4-deab09bb3886 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e2555120-8576-4128-944f-40805aa95a9b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118623) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 18:31:51.670653 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.network.neutron [None req-32d6ff6b-9128-4cae-a991-104d4c2fe7fc tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] validate_networks() for [('c02f9f85-b95f-4513-a67b-ed0864c5046e', None, None, None, None, None)] {{(pid=118624) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 18:31:51.725763 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-ea105a96-999c-4a1c-81e4-deab09bb3886 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.699739 Jun 14 18:31:51.726956 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 289/610] 10.222.0.78 () {62 vars in 1187 bytes} [Tue Jun 14 18:31:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 14 18:31:51.738219 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-f4a6a0cf-ef1e-4462-bd52-a75f9181ae76 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:51.738742 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-f4a6a0cf-ef1e-4462-bd52-a75f9181ae76 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:51.821135 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-f4a6a0cf-ef1e-4462-bd52-a75f9181ae76 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:51.834333 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-f4a6a0cf-ef1e-4462-bd52-a75f9181ae76 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:51.834333 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-f4a6a0cf-ef1e-4462-bd52-a75f9181ae76 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:51.834333 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-f4a6a0cf-ef1e-4462-bd52-a75f9181ae76 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1282 microversion: 2.20 time: 0.100653 Jun 14 18:31:51.838032 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 290/611] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:31:51 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1282 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:31:51.971267 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-e253d9d6-a7d2-4cd0-b36d-b4707fe54996 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:51.971884 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-e253d9d6-a7d2-4cd0-b36d-b4707fe54996 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 17641e09-70b6-4020-9fb5-31780056f2d9] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:51.979112 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e253d9d6-a7d2-4cd0-b36d-b4707fe54996 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:51.979456 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e253d9d6-a7d2-4cd0-b36d-b4707fe54996 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:51.980237 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e253d9d6-a7d2-4cd0-b36d-b4707fe54996 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:51.980661 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e253d9d6-a7d2-4cd0-b36d-b4707fe54996 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:52.138164 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-e253d9d6-a7d2-4cd0-b36d-b4707fe54996 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:52.149094 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-e253d9d6-a7d2-4cd0-b36d-b4707fe54996 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9" status: 200 len: 1680 microversion: 2.1 time: 0.180962 Jun 14 18:31:52.153872 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 291/612] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:51 2022] GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9 => generated 1680 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:31:52.316970 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-32d6ff6b-9128-4cae-a991-104d4c2fe7fc tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Flavor limits 0:0:0 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 18:31:52.317543 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-32d6ff6b-9128-4cae-a991-104d4c2fe7fc tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Image limits 0:0:0 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 18:31:52.318229 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-32d6ff6b-9128-4cae-a991-104d4c2fe7fc tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Flavor pref 0:0:0 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 18:31:52.318627 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-32d6ff6b-9128-4cae-a991-104d4c2fe7fc tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Image pref 0:0:0 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 18:31:52.319121 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-32d6ff6b-9128-4cae-a991-104d4c2fe7fc tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 18:31:52.329741 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-32d6ff6b-9128-4cae-a991-104d4c2fe7fc tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:52.330192 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-32d6ff6b-9128-4cae-a991-104d4c2fe7fc tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:52.330988 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-32d6ff6b-9128-4cae-a991-104d4c2fe7fc tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:52.331431 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-32d6ff6b-9128-4cae-a991-104d4c2fe7fc tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:52.350210 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.quota [None req-32d6ff6b-9128-4cae-a991-104d4c2fe7fc tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Getting quotas for project e2f771a602054b349adae092a9d3ed24. Resources: {'instances', 'cores', 'ram'} {{(pid=118624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:31:52.356557 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.quota [None req-32d6ff6b-9128-4cae-a991-104d4c2fe7fc tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Getting quotas for user 922fd1f30c7647fdb19f8f67a39223cc and project e2f771a602054b349adae092a9d3ed24. Resources: {'instances', 'cores', 'ram'} {{(pid=118624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:31:52.368427 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-32d6ff6b-9128-4cae-a991-104d4c2fe7fc tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Going to run 1 instances... {{(pid=118624) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 18:31:52.370729 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-32d6ff6b-9128-4cae-a991-104d4c2fe7fc tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 41923641-5855-4385-8905-cc7dc5a46714] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e2555120-8576-4128-944f-40805aa95a9b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118624) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 18:31:52.524258 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-32d6ff6b-9128-4cae-a991-104d4c2fe7fc tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.965354 Jun 14 18:31:52.524971 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 322/613] 10.222.0.78 () {60 vars in 1146 bytes} [Tue Jun 14 18:31:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 14 18:31:52.539354 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-874fa333-0c4d-497c-86d7-54e7bbcc946e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:52.539354 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-874fa333-0c4d-497c-86d7-54e7bbcc946e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 41923641-5855-4385-8905-cc7dc5a46714] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:52.601357 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-874fa333-0c4d-497c-86d7-54e7bbcc946e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:52.608460 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-874fa333-0c4d-497c-86d7-54e7bbcc946e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714" status: 200 len: 1237 microversion: 2.1 time: 0.076837 Jun 14 18:31:52.614775 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 292/614] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:52 2022] GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714 => generated 1237 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:52.855265 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-23ecafa0-4262-4aa8-9009-6acb6f2ac495 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:52.855888 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-23ecafa0-4262-4aa8-9009-6acb6f2ac495 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:52.863989 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-23ecafa0-4262-4aa8-9009-6acb6f2ac495 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:52.864345 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-23ecafa0-4262-4aa8-9009-6acb6f2ac495 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:52.865087 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-23ecafa0-4262-4aa8-9009-6acb6f2ac495 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:52.865621 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-23ecafa0-4262-4aa8-9009-6acb6f2ac495 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:52.957558 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-23ecafa0-4262-4aa8-9009-6acb6f2ac495 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:52.967787 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-23ecafa0-4262-4aa8-9009-6acb6f2ac495 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:52.969294 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-23ecafa0-4262-4aa8-9009-6acb6f2ac495 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:52.970498 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-23ecafa0-4262-4aa8-9009-6acb6f2ac495 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1286 microversion: 2.20 time: 0.121571 Jun 14 18:31:52.971249 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 323/615] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:31:52 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1286 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:31:53.173981 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-2762dcfa-529c-4744-8e79-69c60c004c30 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:53.175174 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-2762dcfa-529c-4744-8e79-69c60c004c30 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 17641e09-70b6-4020-9fb5-31780056f2d9] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:53.187083 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2762dcfa-529c-4744-8e79-69c60c004c30 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:53.187530 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2762dcfa-529c-4744-8e79-69c60c004c30 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:53.191069 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2762dcfa-529c-4744-8e79-69c60c004c30 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:53.191606 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2762dcfa-529c-4744-8e79-69c60c004c30 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:53.270657 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-2762dcfa-529c-4744-8e79-69c60c004c30 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:53.278923 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-2762dcfa-529c-4744-8e79-69c60c004c30 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9" status: 200 len: 1613 microversion: 2.1 time: 0.115437 Jun 14 18:31:53.279499 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 293/616] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:53 2022] GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9 => generated 1613 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:53.459463 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-a5e60749-3c75-4d52-9962-0d8436362e93 req-f4d75ba9-4b66-4958-ad92-3608483c0b96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17641e09-70b6-4020-9fb5-31780056f2d9", "name": "network-vif-deleted", "tag": "fb8d49e9-2644-493b-ba67-f249b7b5c2b1"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:31:53.469035 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-a5e60749-3c75-4d52-9962-0d8436362e93 req-f4d75ba9-4b66-4958-ad92-3608483c0b96 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:53.469512 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-a5e60749-3c75-4d52-9962-0d8436362e93 req-f4d75ba9-4b66-4958-ad92-3608483c0b96 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:53.482515 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-a5e60749-3c75-4d52-9962-0d8436362e93 req-f4d75ba9-4b66-4958-ad92-3608483c0b96 service nova] Creating event network-vif-deleted:fb8d49e9-2644-493b-ba67-f249b7b5c2b1 for instance 17641e09-70b6-4020-9fb5-31780056f2d9 on hv-cinder-84456 Jun 14 18:31:53.487848 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-a5e60749-3c75-4d52-9962-0d8436362e93 req-f4d75ba9-4b66-4958-ad92-3608483c0b96 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032073 Jun 14 18:31:53.488615 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 324/617] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:31:53.628272 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-2008a523-0e5f-4998-9db7-8d969084c7fe tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:53.629115 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-2008a523-0e5f-4998-9db7-8d969084c7fe tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 41923641-5855-4385-8905-cc7dc5a46714] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:53.637050 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2008a523-0e5f-4998-9db7-8d969084c7fe tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:53.637745 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2008a523-0e5f-4998-9db7-8d969084c7fe tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:53.638816 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2008a523-0e5f-4998-9db7-8d969084c7fe tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:53.639455 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2008a523-0e5f-4998-9db7-8d969084c7fe tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:53.735005 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-2008a523-0e5f-4998-9db7-8d969084c7fe tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:53.744736 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-2008a523-0e5f-4998-9db7-8d969084c7fe tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714" status: 200 len: 1241 microversion: 2.1 time: 0.122391 Jun 14 18:31:53.745356 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 294/618] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:53 2022] GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714 => generated 1241 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:53.990348 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-8fa77096-048e-4602-bf66-a4eb1dd4cb28 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:53.991041 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-8fa77096-048e-4602-bf66-a4eb1dd4cb28 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:53.998149 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8fa77096-048e-4602-bf66-a4eb1dd4cb28 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:53.998593 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8fa77096-048e-4602-bf66-a4eb1dd4cb28 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:53.999379 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8fa77096-048e-4602-bf66-a4eb1dd4cb28 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:53.999817 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8fa77096-048e-4602-bf66-a4eb1dd4cb28 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:54.068540 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-8fa77096-048e-4602-bf66-a4eb1dd4cb28 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:54.078185 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-8fa77096-048e-4602-bf66-a4eb1dd4cb28 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:54.079705 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-8fa77096-048e-4602-bf66-a4eb1dd4cb28 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:54.080839 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-8fa77096-048e-4602-bf66-a4eb1dd4cb28 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1342 microversion: 2.20 time: 0.094771 Jun 14 18:31:54.081521 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 325/619] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:31:53 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1342 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:31:54.301659 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-07d3763b-17fc-481f-a8a2-abde84ab15d7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:54.302672 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-07d3763b-17fc-481f-a8a2-abde84ab15d7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 17641e09-70b6-4020-9fb5-31780056f2d9] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:54.310340 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-07d3763b-17fc-481f-a8a2-abde84ab15d7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:54.311195 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-07d3763b-17fc-481f-a8a2-abde84ab15d7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:54.312191 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-07d3763b-17fc-481f-a8a2-abde84ab15d7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:54.312721 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-07d3763b-17fc-481f-a8a2-abde84ab15d7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:54.350858 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-07d3763b-17fc-481f-a8a2-abde84ab15d7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:54.351588 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-07d3763b-17fc-481f-a8a2-abde84ab15d7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:54.352306 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.objects.instance [None req-07d3763b-17fc-481f-a8a2-abde84ab15d7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lazy-loading 'fault' on Instance uuid 17641e09-70b6-4020-9fb5-31780056f2d9 {{(pid=118623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:31:54.400001 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-07d3763b-17fc-481f-a8a2-abde84ab15d7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:54.408700 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-07d3763b-17fc-481f-a8a2-abde84ab15d7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9" status: 200 len: 1331 microversion: 2.1 time: 0.114749 Jun 14 18:31:54.409278 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 295/620] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:54 2022] GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9 => generated 1331 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:54.763224 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-e11adb72-2294-4511-983f-5970f158dd69 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:54.768929 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-e11adb72-2294-4511-983f-5970f158dd69 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 41923641-5855-4385-8905-cc7dc5a46714] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:54.771585 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:31:54.777283 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e11adb72-2294-4511-983f-5970f158dd69 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:54.778340 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e11adb72-2294-4511-983f-5970f158dd69 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:54.780232 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e11adb72-2294-4511-983f-5970f158dd69 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:54.780663 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e11adb72-2294-4511-983f-5970f158dd69 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:54.893657 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-e11adb72-2294-4511-983f-5970f158dd69 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:54.901782 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-e11adb72-2294-4511-983f-5970f158dd69 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714" status: 200 len: 1289 microversion: 2.1 time: 0.143972 Jun 14 18:31:54.902365 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 326/621] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:54 2022] GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714 => generated 1289 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:55.109425 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-b0267ed4-3187-4fe2-b9f9-828adc44fdc3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:55.110919 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-b0267ed4-3187-4fe2-b9f9-828adc44fdc3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:55.119046 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b0267ed4-3187-4fe2-b9f9-828adc44fdc3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:55.119653 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b0267ed4-3187-4fe2-b9f9-828adc44fdc3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:55.120631 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b0267ed4-3187-4fe2-b9f9-828adc44fdc3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:55.121294 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b0267ed4-3187-4fe2-b9f9-828adc44fdc3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:55.126251 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:31:55.266418 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-b0267ed4-3187-4fe2-b9f9-828adc44fdc3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:55.286585 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-b0267ed4-3187-4fe2-b9f9-828adc44fdc3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:55.286585 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-b0267ed4-3187-4fe2-b9f9-828adc44fdc3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:55.286585 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-b0267ed4-3187-4fe2-b9f9-828adc44fdc3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1407 microversion: 2.20 time: 0.178412 Jun 14 18:31:55.287866 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 296/622] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:31:55 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:31:55.431138 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-1112ec2d-f1eb-4023-abfd-f351f053bb6d tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:55.431755 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-1112ec2d-f1eb-4023-abfd-f351f053bb6d tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 17641e09-70b6-4020-9fb5-31780056f2d9] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:55.440605 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1112ec2d-f1eb-4023-abfd-f351f053bb6d tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:55.441436 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1112ec2d-f1eb-4023-abfd-f351f053bb6d tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:55.442549 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1112ec2d-f1eb-4023-abfd-f351f053bb6d tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:55.443059 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1112ec2d-f1eb-4023-abfd-f351f053bb6d tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:55.459314 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.wsgi [None req-1112ec2d-f1eb-4023-abfd-f351f053bb6d tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] HTTP exception thrown: Instance 17641e09-70b6-4020-9fb5-31780056f2d9 could not be found. Jun 14 18:31:55.461248 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-1112ec2d-f1eb-4023-abfd-f351f053bb6d tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Request method failure captured: Jun 14 18:31:55.461248 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: request: GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9 HTTP/1.1 Jun 14 18:31:55.461248 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept: application/json Jun 14 18:31:55.461248 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept-Encoding: identity Jun 14 18:31:55.461248 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Connection: close Jun 14 18:31:55.461248 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Length: 0 Jun 14 18:31:55.461248 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Type: application/json Jun 14 18:31:55.461248 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Host: 10.222.0.78 Jun 14 18:31:55.461248 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Openstack-System-Scope: None Jun 14 18:31:55.461248 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: User-Agent: python-urllib3/1.26.9 Jun 14 18:31:55.461248 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Auth-Token: gAAAAABiqNNRwUW-ILUkPK_wgILFSFKwt3erUOv38mYIB0oCeDDiotO112_xIQykQF206CMg3446rqZisR6hzfab3579MeUncL30z5LdS-2pD1weLSQ2dqyxdVYPdVwx-jGbuP7Kwf2vbYNW1CdwMR0V5q1_4RRQAdNuD7UVUw8E8v9L5saJIsU Jun 14 18:31:55.461248 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Id: None Jun 14 18:31:55.461248 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Name: None Jun 14 18:31:55.461248 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Identity-Status: Confirmed Jun 14 18:31:55.461248 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Is-Admin-Project: True Jun 14 18:31:55.461248 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Id: default Jun 14 18:31:55.461248 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Name: Default Jun 14 18:31:55.461248 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Id: 56f8367a52044e82a2c272da39e1bfd8 Jun 14 18:31:55.461248 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Name: tempest-AttachVolumeNegativeTest-1598181014 Jun 14 18:31:55.461248 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Role: reader,member Jun 14 18:31:55.461248 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Roles: reader,member Jun 14 18:31:55.462770 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_56f8367a52044e82a2c272da39e1bfd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/56f8367a52044e82a2c272da39e1bfd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/56f8367a52044e82a2c272da39e1bfd8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/56f8367a52044e82a2c272da39e1bfd8"}]}] Jun 14 18:31:55.462770 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant: tempest-AttachVolumeNegativeTest-1598181014 Jun 14 18:31:55.462770 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Id: 56f8367a52044e82a2c272da39e1bfd8 Jun 14 18:31:55.462770 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1598181014 Jun 14 18:31:55.462770 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User: tempest-AttachVolumeNegativeTest-1598181014-project Jun 14 18:31:55.462770 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Id: default Jun 14 18:31:55.462770 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Name: Default Jun 14 18:31:55.462770 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Id: 9254bd46822346009497b01d28314335 Jun 14 18:31:55.462770 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Name: tempest-AttachVolumeNegativeTest-1598181014-project Jun 14 18:31:55.462770 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: method: > Jun 14 18:31:55.462770 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: exception: Instance 17641e09-70b6-4020-9fb5-31780056f2d9 could not be found. Jun 14 18:31:55.462770 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: action_args: {'id': '17641e09-70b6-4020-9fb5-31780056f2d9'} Jun 14 18:31:55.463621 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:31:55.463621 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:31:55.463621 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:31:55.463621 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:31:55.463621 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:31:55.463621 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:31:55.463621 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:31:55.463621 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:31:55.463621 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:31:55.463621 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:31:55.463621 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17641e09-70b6-4020-9fb5-31780056f2d9 could not be found. Jun 14 18:31:55.463621 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:31:55.463621 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:31:55.463621 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:31:55.463621 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:31:55.463621 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:31:55.463621 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:31:55.463621 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:31:55.463621 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:31:55.463621 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:31:55.464884 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:31:55.464884 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:31:55.464884 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:31:55.464884 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:31:55.464884 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:31:55.464884 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:31:55.464884 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:31:55.464884 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17641e09-70b6-4020-9fb5-31780056f2d9 could not be found. Jun 14 18:31:55.464884 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:31:55.464884 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:31:55.464884 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:31:55.464884 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:31:55.464884 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:31:55.464884 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:31:55.464884 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:31:55.464884 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:31:55.464884 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17641e09-70b6-4020-9fb5-31780056f2d9 could not be found. Jun 14 18:31:55.464884 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:31:55.466066 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-1112ec2d-f1eb-4023-abfd-f351f053bb6d tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Returning 404 to user: Instance 17641e09-70b6-4020-9fb5-31780056f2d9 could not be found. {{(pid=118624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:31:55.466066 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-1112ec2d-f1eb-4023-abfd-f351f053bb6d tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9" status: 404 len: 111 microversion: 2.1 time: 0.036493 Jun 14 18:31:55.466066 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 327/623] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:55 2022] GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:31:55.472350 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-318ba7a6-5690-48cf-84f3-935d7fb04a1b tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '.version_select at 0x7efe70a6b700>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:55.570337 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-318ba7a6-5690-48cf-84f3-935d7fb04a1b tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-412435349" status: 202 len: 0 microversion: 2.1 time: 0.101133 Jun 14 18:31:55.570890 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 297/624] 10.222.0.78 () {58 vars in 1217 bytes} [Tue Jun 14 18:31:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-412435349 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:31:55.931608 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-fc655c4b-43fc-4be7-8140-b8d52f05f3e3 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:55.940706 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-fc655c4b-43fc-4be7-8140-b8d52f05f3e3 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 41923641-5855-4385-8905-cc7dc5a46714] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:55.982095 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-fc655c4b-43fc-4be7-8140-b8d52f05f3e3 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:55.982762 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-fc655c4b-43fc-4be7-8140-b8d52f05f3e3 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:55.984200 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-fc655c4b-43fc-4be7-8140-b8d52f05f3e3 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:55.988883 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-fc655c4b-43fc-4be7-8140-b8d52f05f3e3 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:56.110852 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-fc655c4b-43fc-4be7-8140-b8d52f05f3e3 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:56.120077 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-fc655c4b-43fc-4be7-8140-b8d52f05f3e3 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714" status: 200 len: 1295 microversion: 2.1 time: 0.204643 Jun 14 18:31:56.122313 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 328/625] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:55 2022] GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714 => generated 1295 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:56.303072 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-9c56d664-1a0f-4a82-92a5-ae76aa7ff18f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:56.304887 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-9c56d664-1a0f-4a82-92a5-ae76aa7ff18f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:56.315613 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9c56d664-1a0f-4a82-92a5-ae76aa7ff18f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:56.316030 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9c56d664-1a0f-4a82-92a5-ae76aa7ff18f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:56.316738 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9c56d664-1a0f-4a82-92a5-ae76aa7ff18f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:56.317175 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9c56d664-1a0f-4a82-92a5-ae76aa7ff18f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:56.690291 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-9c56d664-1a0f-4a82-92a5-ae76aa7ff18f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:56.742930 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-9c56d664-1a0f-4a82-92a5-ae76aa7ff18f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:56.749817 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-9c56d664-1a0f-4a82-92a5-ae76aa7ff18f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:56.751952 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-658eafac-c47f-4eb4-add8-acc5d6cdbabc tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Action: 'create', calling method: .version_select at 0x7efe70172670>, body: {"keypair": {"name": "tempest-keypair-573521088", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTOftNC6j5kat4XH4RlLY4kj/geGwED+yLaIvrg9IFDOzVCYjjpvGIbwNNgHnFQl2zRUHciEiEzczl30fAub5gDh4ZBUGZ/xXi9N5pjltiHsw+pPKMsJH3VJnrCHluMOg=="}} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:31:56.752750 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-9c56d664-1a0f-4a82-92a5-ae76aa7ff18f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1407 microversion: 2.20 time: 0.453615 Jun 14 18:31:56.754299 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 298/626] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:31:56 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1407 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:31:56.775462 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.quota [None req-658eafac-c47f-4eb4-add8-acc5d6cdbabc tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Getting quotas for project 56f8367a52044e82a2c272da39e1bfd8. Resources: {'key_pairs'} {{(pid=118624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:31:56.777324 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.quota [None req-658eafac-c47f-4eb4-add8-acc5d6cdbabc tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Getting quotas for user 9254bd46822346009497b01d28314335 and project 56f8367a52044e82a2c272da39e1bfd8. Resources: {'key_pairs'} {{(pid=118624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:31:56.856950 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-a8d15391-c763-43ca-a588-dfa73960a95b req-398d0424-7899-430c-9b5d-9c3420521939 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86678293-5e78-4bb0-9bc8-0a02da6d1a0b", "tag": "9a48c21f-378c-4db8-a26f-6ed7263009cb"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:31:56.896665 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-658eafac-c47f-4eb4-add8-acc5d6cdbabc tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.151066 Jun 14 18:31:56.904404 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 329/627] 10.222.0.78 () {60 vars in 1158 bytes} [Tue Jun 14 18:31:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:31:56.911026 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-a8d15391-c763-43ca-a588-dfa73960a95b req-398d0424-7899-430c-9b5d-9c3420521939 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:56.911787 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-a8d15391-c763-43ca-a588-dfa73960a95b req-398d0424-7899-430c-9b5d-9c3420521939 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:56.928787 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-a8d15391-c763-43ca-a588-dfa73960a95b req-398d0424-7899-430c-9b5d-9c3420521939 service nova] Creating event network-changed:9a48c21f-378c-4db8-a26f-6ed7263009cb for instance 86678293-5e78-4bb0-9bc8-0a02da6d1a0b on hv-cinder-84456 Jun 14 18:31:56.937630 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-a8d15391-c763-43ca-a588-dfa73960a95b req-398d0424-7899-430c-9b5d-9c3420521939 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089227 Jun 14 18:31:56.938702 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 299/628] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:31:57.147276 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-9cb85c4d-bff3-4b18-a4a8-9ea1649016a5 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:57.148255 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-9cb85c4d-bff3-4b18-a4a8-9ea1649016a5 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 41923641-5855-4385-8905-cc7dc5a46714] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:57.155713 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9cb85c4d-bff3-4b18-a4a8-9ea1649016a5 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:57.156433 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9cb85c4d-bff3-4b18-a4a8-9ea1649016a5 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:57.157690 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9cb85c4d-bff3-4b18-a4a8-9ea1649016a5 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:57.158326 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9cb85c4d-bff3-4b18-a4a8-9ea1649016a5 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:57.627835 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-9cb85c4d-bff3-4b18-a4a8-9ea1649016a5 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:57.638249 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-9cb85c4d-bff3-4b18-a4a8-9ea1649016a5 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714" status: 200 len: 1363 microversion: 2.1 time: 0.494219 Jun 14 18:31:57.639223 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 330/629] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:57 2022] GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714 => generated 1363 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:57.785874 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-202d8bda-a429-4db6-86b8-89466b54b8d6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:57.787317 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-202d8bda-a429-4db6-86b8-89466b54b8d6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:57.817819 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-202d8bda-a429-4db6-86b8-89466b54b8d6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:57.818778 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-202d8bda-a429-4db6-86b8-89466b54b8d6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:57.821854 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-202d8bda-a429-4db6-86b8-89466b54b8d6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:57.822792 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-202d8bda-a429-4db6-86b8-89466b54b8d6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:58.081613 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-202d8bda-a429-4db6-86b8-89466b54b8d6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:58.094050 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-202d8bda-a429-4db6-86b8-89466b54b8d6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:58.095621 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-202d8bda-a429-4db6-86b8-89466b54b8d6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:58.097037 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-202d8bda-a429-4db6-86b8-89466b54b8d6 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1407 microversion: 2.20 time: 0.327816 Jun 14 18:31:58.097622 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 300/630] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:31:57 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1407 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:31:58.664782 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-6c6ad2da-76a7-463f-b574-ae324282a8ee tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:58.665825 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-6c6ad2da-76a7-463f-b574-ae324282a8ee tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 41923641-5855-4385-8905-cc7dc5a46714] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:58.675848 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6c6ad2da-76a7-463f-b574-ae324282a8ee tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:58.676551 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6c6ad2da-76a7-463f-b574-ae324282a8ee tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:58.677958 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6c6ad2da-76a7-463f-b574-ae324282a8ee tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:58.678516 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6c6ad2da-76a7-463f-b574-ae324282a8ee tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:58.858628 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-6c6ad2da-76a7-463f-b574-ae324282a8ee tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:58.873944 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-6c6ad2da-76a7-463f-b574-ae324282a8ee tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714" status: 200 len: 1363 microversion: 2.1 time: 0.214289 Jun 14 18:31:58.875184 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 331/631] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:58 2022] GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:31:58.961973 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-20c062d7-70bd-4fbe-9116-8cf431668c1c req-2d833882-b582-45ac-ac96-476dc62bb636 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41923641-5855-4385-8905-cc7dc5a46714", "tag": "1754f2cd-b7cf-4e61-9902-e19aa00b1cb0"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:31:58.971325 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-20c062d7-70bd-4fbe-9116-8cf431668c1c req-2d833882-b582-45ac-ac96-476dc62bb636 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:58.971747 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-20c062d7-70bd-4fbe-9116-8cf431668c1c req-2d833882-b582-45ac-ac96-476dc62bb636 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:58.985564 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-20c062d7-70bd-4fbe-9116-8cf431668c1c req-2d833882-b582-45ac-ac96-476dc62bb636 service nova] Creating event network-changed:1754f2cd-b7cf-4e61-9902-e19aa00b1cb0 for instance 41923641-5855-4385-8905-cc7dc5a46714 on hv-cinder-84456 Jun 14 18:31:58.990843 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-20c062d7-70bd-4fbe-9116-8cf431668c1c req-2d833882-b582-45ac-ac96-476dc62bb636 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033369 Jun 14 18:31:58.991545 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 301/632] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:31:59.123788 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-55898350-5d61-4057-b148-30c368c03ce0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:59.124550 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-55898350-5d61-4057-b148-30c368c03ce0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:59.135214 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-55898350-5d61-4057-b148-30c368c03ce0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:59.135214 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-55898350-5d61-4057-b148-30c368c03ce0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:59.135214 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-55898350-5d61-4057-b148-30c368c03ce0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:59.135214 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-55898350-5d61-4057-b148-30c368c03ce0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:59.504699 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-55898350-5d61-4057-b148-30c368c03ce0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:59.516124 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-55898350-5d61-4057-b148-30c368c03ce0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:59.518494 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-55898350-5d61-4057-b148-30c368c03ce0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:31:59.519817 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-55898350-5d61-4057-b148-30c368c03ce0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1407 microversion: 2.20 time: 0.400331 Jun 14 18:31:59.520468 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 332/633] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:31:59 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1407 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:31:59.706857 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-d2740726-7f84-490b-8623-7ee1299ce164 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-865901178", "imageRef": "e2555120-8576-4128-944f-40805aa95a9b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e21b4aaa-368c-485d-acb4-337720920cc4"}], "security_groups": [{"name": "tempest-securitygroup--179021351"}], "key_name": "tempest-keypair-573521088", "user_data": "}} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:31:59.853161 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.network.neutron [None req-d2740726-7f84-490b-8623-7ee1299ce164 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] validate_networks() for [('e21b4aaa-368c-485d-acb4-337720920cc4', None, None, None, None, None)] {{(pid=118623) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 18:31:59.901519 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-4f3bf080-70fc-42e7-8331-a697a2c4d6e0 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:31:59.902313 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-4f3bf080-70fc-42e7-8331-a697a2c4d6e0 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 41923641-5855-4385-8905-cc7dc5a46714] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:31:59.909781 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4f3bf080-70fc-42e7-8331-a697a2c4d6e0 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:59.910244 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4f3bf080-70fc-42e7-8331-a697a2c4d6e0 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:59.911071 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4f3bf080-70fc-42e7-8331-a697a2c4d6e0 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:31:59.911509 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4f3bf080-70fc-42e7-8331-a697a2c4d6e0 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:31:59.921733 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:32:00.291819 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-4f3bf080-70fc-42e7-8331-a697a2c4d6e0 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:00.300090 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-4f3bf080-70fc-42e7-8331-a697a2c4d6e0 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714" status: 200 len: 1363 microversion: 2.1 time: 0.403659 Jun 14 18:32:00.301056 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 333/634] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:31:59 2022] GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714 => generated 1363 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:32:00.541169 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-7a880f83-f85e-4ed1-bcc4-6b0bfcd5ac0c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:00.542563 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-7a880f83-f85e-4ed1-bcc4-6b0bfcd5ac0c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:00.549094 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7a880f83-f85e-4ed1-bcc4-6b0bfcd5ac0c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:00.549581 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7a880f83-f85e-4ed1-bcc4-6b0bfcd5ac0c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:00.550363 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7a880f83-f85e-4ed1-bcc4-6b0bfcd5ac0c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:00.550808 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7a880f83-f85e-4ed1-bcc4-6b0bfcd5ac0c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:00.565443 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-d2740726-7f84-490b-8623-7ee1299ce164 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Flavor limits 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 18:32:00.567381 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-d2740726-7f84-490b-8623-7ee1299ce164 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Image limits 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 18:32:00.567882 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-d2740726-7f84-490b-8623-7ee1299ce164 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Flavor pref 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 18:32:00.568300 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-d2740726-7f84-490b-8623-7ee1299ce164 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Image pref 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 18:32:00.568751 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-d2740726-7f84-490b-8623-7ee1299ce164 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 18:32:00.585623 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d2740726-7f84-490b-8623-7ee1299ce164 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:00.586219 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d2740726-7f84-490b-8623-7ee1299ce164 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:00.587002 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d2740726-7f84-490b-8623-7ee1299ce164 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:00.587450 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d2740726-7f84-490b-8623-7ee1299ce164 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:00.606636 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.quota [None req-d2740726-7f84-490b-8623-7ee1299ce164 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Getting quotas for project 56f8367a52044e82a2c272da39e1bfd8. Resources: {'instances', 'cores', 'ram'} {{(pid=118623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:32:00.611045 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.quota [None req-d2740726-7f84-490b-8623-7ee1299ce164 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Getting quotas for user 9254bd46822346009497b01d28314335 and project 56f8367a52044e82a2c272da39e1bfd8. Resources: {'instances', 'cores', 'ram'} {{(pid=118623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:32:00.623353 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-d2740726-7f84-490b-8623-7ee1299ce164 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Going to run 1 instances... {{(pid=118623) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 18:32:00.625831 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-d2740726-7f84-490b-8623-7ee1299ce164 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e2555120-8576-4128-944f-40805aa95a9b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118623) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 18:32:00.692827 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-7a880f83-f85e-4ed1-bcc4-6b0bfcd5ac0c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:00.701713 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-7a880f83-f85e-4ed1-bcc4-6b0bfcd5ac0c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:00.704253 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-7a880f83-f85e-4ed1-bcc4-6b0bfcd5ac0c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:00.704457 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-7a880f83-f85e-4ed1-bcc4-6b0bfcd5ac0c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1407 microversion: 2.20 time: 0.167892 Jun 14 18:32:00.704975 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 334/635] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:32:00 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:32:00.782373 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-d2740726-7f84-490b-8623-7ee1299ce164 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.080676 Jun 14 18:32:00.782980 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 302/636] 10.222.0.78 () {60 vars in 1146 bytes} [Tue Jun 14 18:31:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 1083 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 18:32:00.793788 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-f069c506-723a-4417-81ed-f98aa9ad946b tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:00.794398 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-f069c506-723a-4417-81ed-f98aa9ad946b tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:00.848785 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-f069c506-723a-4417-81ed-f98aa9ad946b tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:00.856759 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-f069c506-723a-4417-81ed-f98aa9ad946b tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94" status: 200 len: 1240 microversion: 2.1 time: 0.067248 Jun 14 18:32:00.857352 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 335/637] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:00 2022] GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94 => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:32:01.318364 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-0867bc05-4029-47b7-8d51-0995380eab0c tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:01.318894 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-0867bc05-4029-47b7-8d51-0995380eab0c tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 41923641-5855-4385-8905-cc7dc5a46714] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:01.325669 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0867bc05-4029-47b7-8d51-0995380eab0c tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:01.326133 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0867bc05-4029-47b7-8d51-0995380eab0c tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:01.326910 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0867bc05-4029-47b7-8d51-0995380eab0c tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:01.327351 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0867bc05-4029-47b7-8d51-0995380eab0c tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:01.572920 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-0867bc05-4029-47b7-8d51-0995380eab0c tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:01.580745 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-0867bc05-4029-47b7-8d51-0995380eab0c tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714" status: 200 len: 1363 microversion: 2.1 time: 0.266879 Jun 14 18:32:01.583961 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 303/638] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:01 2022] GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714 => generated 1363 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:32:01.724553 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-c097030b-9f38-4d00-abdd-c2142586dcfb tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:01.726186 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-c097030b-9f38-4d00-abdd-c2142586dcfb tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:01.738095 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c097030b-9f38-4d00-abdd-c2142586dcfb tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:01.738790 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c097030b-9f38-4d00-abdd-c2142586dcfb tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:01.740269 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c097030b-9f38-4d00-abdd-c2142586dcfb tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:01.741067 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c097030b-9f38-4d00-abdd-c2142586dcfb tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:01.875703 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-25f34825-f792-4553-bbfa-9859abe51d16 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:01.876576 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-25f34825-f792-4553-bbfa-9859abe51d16 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:01.884836 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-25f34825-f792-4553-bbfa-9859abe51d16 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:01.885285 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-25f34825-f792-4553-bbfa-9859abe51d16 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:01.886106 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-25f34825-f792-4553-bbfa-9859abe51d16 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:01.886570 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-25f34825-f792-4553-bbfa-9859abe51d16 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:01.944112 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-c097030b-9f38-4d00-abdd-c2142586dcfb tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:01.959372 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-c097030b-9f38-4d00-abdd-c2142586dcfb tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:01.964274 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-c097030b-9f38-4d00-abdd-c2142586dcfb tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:01.966488 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-c097030b-9f38-4d00-abdd-c2142586dcfb tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1407 microversion: 2.20 time: 0.247758 Jun 14 18:32:01.967641 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 336/639] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:32:01 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1407 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:32:01.994770 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-25f34825-f792-4553-bbfa-9859abe51d16 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:02.003093 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-25f34825-f792-4553-bbfa-9859abe51d16 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94" status: 200 len: 1244 microversion: 2.1 time: 0.133358 Jun 14 18:32:02.004414 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 304/640] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:01 2022] GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94 => generated 1244 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:32:02.598247 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-f5e62849-dfc3-4f37-8c44-4d652e41bb6d tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:02.598894 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-f5e62849-dfc3-4f37-8c44-4d652e41bb6d tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 41923641-5855-4385-8905-cc7dc5a46714] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:02.600975 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell0:SELECT=2 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:32:02.606889 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f5e62849-dfc3-4f37-8c44-4d652e41bb6d tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:02.613618 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f5e62849-dfc3-4f37-8c44-4d652e41bb6d tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:02.613618 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f5e62849-dfc3-4f37-8c44-4d652e41bb6d tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:02.613618 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f5e62849-dfc3-4f37-8c44-4d652e41bb6d tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:02.807870 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-9d522408-dfc0-4551-911f-2e63fc826141 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:02.808421 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-9d522408-dfc0-4551-911f-2e63fc826141 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:02.815629 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9d522408-dfc0-4551-911f-2e63fc826141 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:02.816087 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9d522408-dfc0-4551-911f-2e63fc826141 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:02.816957 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9d522408-dfc0-4551-911f-2e63fc826141 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:02.817658 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9d522408-dfc0-4551-911f-2e63fc826141 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:02.840261 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-f5e62849-dfc3-4f37-8c44-4d652e41bb6d tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:02.852435 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-f5e62849-dfc3-4f37-8c44-4d652e41bb6d tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714" status: 200 len: 1363 microversion: 2.1 time: 0.257712 Jun 14 18:32:02.853435 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 337/641] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:02 2022] GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714 => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:32:02.910142 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.objects.instance [None req-9d522408-dfc0-4551-911f-2e63fc826141 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lazy-loading 'services' on Instance uuid e66ffa48-038e-40ba-b075-bafc9eb4b015 {{(pid=118623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:32:02.998389 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-3f3d4aa6-ebe1-4d40-9e7d-db068336b202 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:02.999648 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-3f3d4aa6-ebe1-4d40-9e7d-db068336b202 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:03.011606 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3f3d4aa6-ebe1-4d40-9e7d-db068336b202 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:03.012568 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3f3d4aa6-ebe1-4d40-9e7d-db068336b202 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:03.014355 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3f3d4aa6-ebe1-4d40-9e7d-db068336b202 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:03.015526 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3f3d4aa6-ebe1-4d40-9e7d-db068336b202 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:03.235157 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-9d522408-dfc0-4551-911f-2e63fc826141 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015/os-volume_attachments/402021d3-07bc-4453-9422-1aa4fb65a611" status: 202 len: 0 microversion: 2.1 time: 0.431731 Jun 14 18:32:03.239666 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 305/642] 10.222.0.78 () {58 vars in 1415 bytes} [Tue Jun 14 18:32:02 2022] DELETE /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015/os-volume_attachments/402021d3-07bc-4453-9422-1aa4fb65a611 => generated 0 bytes in 437 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 14 18:32:03.246130 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-5dfcd6c4-9d49-4d36-b41f-d566f45a5bb2 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:03.259030 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-5dfcd6c4-9d49-4d36-b41f-d566f45a5bb2 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:03.277002 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5dfcd6c4-9d49-4d36-b41f-d566f45a5bb2 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:03.277809 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5dfcd6c4-9d49-4d36-b41f-d566f45a5bb2 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:03.282179 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5dfcd6c4-9d49-4d36-b41f-d566f45a5bb2 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:03.282881 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5dfcd6c4-9d49-4d36-b41f-d566f45a5bb2 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:03.295492 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-3f3d4aa6-ebe1-4d40-9e7d-db068336b202 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:03.314162 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-3f3d4aa6-ebe1-4d40-9e7d-db068336b202 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:03.315697 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-3f3d4aa6-ebe1-4d40-9e7d-db068336b202 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:03.317066 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-3f3d4aa6-ebe1-4d40-9e7d-db068336b202 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1407 microversion: 2.20 time: 0.327259 Jun 14 18:32:03.336216 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 338/643] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:32:02 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1407 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:32:03.350327 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-7864110d-eb79-4184-8103-2babb7a9ad76 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:03.352020 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-7864110d-eb79-4184-8103-2babb7a9ad76 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:03.362970 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7864110d-eb79-4184-8103-2babb7a9ad76 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:03.362970 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7864110d-eb79-4184-8103-2babb7a9ad76 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:03.362970 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7864110d-eb79-4184-8103-2babb7a9ad76 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:03.362970 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7864110d-eb79-4184-8103-2babb7a9ad76 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:03.389166 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-5dfcd6c4-9d49-4d36-b41f-d566f45a5bb2 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:03.400311 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-5dfcd6c4-9d49-4d36-b41f-d566f45a5bb2 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94" status: 200 len: 1300 microversion: 2.1 time: 0.159211 Jun 14 18:32:03.412067 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 306/644] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:03 2022] GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94 => generated 1300 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:32:03.427662 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-afd3e0df-e0d7-472e-bddc-b19d4b98bd01 req-38f103a4-337a-42a2-a194-9a5b3be4b9c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86678293-5e78-4bb0-9bc8-0a02da6d1a0b", "name": "network-vif-plugged", "status": "completed", "tag": "9a48c21f-378c-4db8-a26f-6ed7263009cb"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:32:03.438549 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-afd3e0df-e0d7-472e-bddc-b19d4b98bd01 req-38f103a4-337a-42a2-a194-9a5b3be4b9c3 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:03.438993 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-afd3e0df-e0d7-472e-bddc-b19d4b98bd01 req-38f103a4-337a-42a2-a194-9a5b3be4b9c3 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:03.455748 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-7864110d-eb79-4184-8103-2babb7a9ad76 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117312 Jun 14 18:32:03.457498 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 339/645] 10.222.0.78 () {58 vars in 1301 bytes} [Tue Jun 14 18:32:03 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:32:03.463346 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-afd3e0df-e0d7-472e-bddc-b19d4b98bd01 req-38f103a4-337a-42a2-a194-9a5b3be4b9c3 service nova] Creating event network-vif-plugged:9a48c21f-378c-4db8-a26f-6ed7263009cb for instance 86678293-5e78-4bb0-9bc8-0a02da6d1a0b on hv-cinder-84456 Jun 14 18:32:03.481199 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-afd3e0df-e0d7-472e-bddc-b19d4b98bd01 req-38f103a4-337a-42a2-a194-9a5b3be4b9c3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053730 Jun 14 18:32:03.481199 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 307/646] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:32:03.870397 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-34a471e7-c2a0-4a7c-affc-25de8bd2ea54 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:03.870998 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-34a471e7-c2a0-4a7c-affc-25de8bd2ea54 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 41923641-5855-4385-8905-cc7dc5a46714] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:03.877792 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-34a471e7-c2a0-4a7c-affc-25de8bd2ea54 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:03.878233 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-34a471e7-c2a0-4a7c-affc-25de8bd2ea54 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:03.879002 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-34a471e7-c2a0-4a7c-affc-25de8bd2ea54 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:03.879455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-34a471e7-c2a0-4a7c-affc-25de8bd2ea54 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:04.053346 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-34a471e7-c2a0-4a7c-affc-25de8bd2ea54 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:04.063125 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-34a471e7-c2a0-4a7c-affc-25de8bd2ea54 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714" status: 200 len: 1363 microversion: 2.1 time: 0.196680 Jun 14 18:32:04.070046 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 340/647] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:03 2022] GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714 => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:32:04.354801 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-a0ed88a2-6ea7-4332-b9a8-4dd4f02fe50c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:04.355649 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-a0ed88a2-6ea7-4332-b9a8-4dd4f02fe50c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:04.363038 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a0ed88a2-6ea7-4332-b9a8-4dd4f02fe50c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:04.363627 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a0ed88a2-6ea7-4332-b9a8-4dd4f02fe50c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:04.364506 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a0ed88a2-6ea7-4332-b9a8-4dd4f02fe50c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:04.364945 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a0ed88a2-6ea7-4332-b9a8-4dd4f02fe50c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:04.432679 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-e1fc086c-0b0f-4ce1-87b9-157e158b2649 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:04.433304 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-e1fc086c-0b0f-4ce1-87b9-157e158b2649 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:04.446324 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e1fc086c-0b0f-4ce1-87b9-157e158b2649 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:04.446782 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e1fc086c-0b0f-4ce1-87b9-157e158b2649 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:04.447580 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e1fc086c-0b0f-4ce1-87b9-157e158b2649 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:04.448017 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e1fc086c-0b0f-4ce1-87b9-157e158b2649 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:04.557489 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-a0ed88a2-6ea7-4332-b9a8-4dd4f02fe50c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:04.566196 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-a0ed88a2-6ea7-4332-b9a8-4dd4f02fe50c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:04.567795 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-a0ed88a2-6ea7-4332-b9a8-4dd4f02fe50c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:04.569033 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-a0ed88a2-6ea7-4332-b9a8-4dd4f02fe50c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1407 microversion: 2.20 time: 0.218911 Jun 14 18:32:04.570426 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 308/648] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:32:04 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:32:04.572645 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-e1fc086c-0b0f-4ce1-87b9-157e158b2649 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:04.575918 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-1b233702-accf-4d6b-a1c7-ebec3102b52c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:04.577170 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-1b233702-accf-4d6b-a1c7-ebec3102b52c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:04.584008 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-e1fc086c-0b0f-4ce1-87b9-157e158b2649 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94" status: 200 len: 1298 microversion: 2.1 time: 0.155515 Jun 14 18:32:04.584634 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 341/649] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:04 2022] GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94 => generated 1298 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:32:04.585230 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1b233702-accf-4d6b-a1c7-ebec3102b52c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:04.585700 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1b233702-accf-4d6b-a1c7-ebec3102b52c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:04.586629 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1b233702-accf-4d6b-a1c7-ebec3102b52c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:04.587063 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1b233702-accf-4d6b-a1c7-ebec3102b52c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:04.622650 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-1b233702-accf-4d6b-a1c7-ebec3102b52c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050955 Jun 14 18:32:04.623232 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 309/650] 10.222.0.78 () {58 vars in 1301 bytes} [Tue Jun 14 18:32:04 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:32:05.082575 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-97cfb65f-f038-41af-a1fb-b5504a3b93fc tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:05.083831 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-97cfb65f-f038-41af-a1fb-b5504a3b93fc tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 41923641-5855-4385-8905-cc7dc5a46714] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:05.091747 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-97cfb65f-f038-41af-a1fb-b5504a3b93fc tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:05.092210 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-97cfb65f-f038-41af-a1fb-b5504a3b93fc tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:05.093008 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-97cfb65f-f038-41af-a1fb-b5504a3b93fc tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:05.093662 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-97cfb65f-f038-41af-a1fb-b5504a3b93fc tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:05.496032 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-b0dc0eb7-0e28-459e-95d8-4d0c05e5ccbf req-537b302b-7a84-4a9a-9c70-cea6e2e3a0df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41923641-5855-4385-8905-cc7dc5a46714", "name": "network-vif-plugged", "status": "completed", "tag": "1754f2cd-b7cf-4e61-9902-e19aa00b1cb0"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:32:05.497733 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-97cfb65f-f038-41af-a1fb-b5504a3b93fc tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:05.505333 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-b0dc0eb7-0e28-459e-95d8-4d0c05e5ccbf req-537b302b-7a84-4a9a-9c70-cea6e2e3a0df service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:05.505902 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-97cfb65f-f038-41af-a1fb-b5504a3b93fc tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714" status: 200 len: 1363 microversion: 2.1 time: 0.427762 Jun 14 18:32:05.506072 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-b0dc0eb7-0e28-459e-95d8-4d0c05e5ccbf req-537b302b-7a84-4a9a-9c70-cea6e2e3a0df service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:05.506705 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 342/651] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:05 2022] GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714 => generated 1363 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:32:05.521359 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-b0dc0eb7-0e28-459e-95d8-4d0c05e5ccbf req-537b302b-7a84-4a9a-9c70-cea6e2e3a0df service nova] Creating event network-vif-plugged:1754f2cd-b7cf-4e61-9902-e19aa00b1cb0 for instance 41923641-5855-4385-8905-cc7dc5a46714 on hv-cinder-84456 Jun 14 18:32:05.527769 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-b0dc0eb7-0e28-459e-95d8-4d0c05e5ccbf req-537b302b-7a84-4a9a-9c70-cea6e2e3a0df service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035107 Jun 14 18:32:05.528500 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 310/652] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:32:05.589117 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-ec6c0abb-a1a9-4c66-85b3-a34aebf28e57 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:05.590158 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-ec6c0abb-a1a9-4c66-85b3-a34aebf28e57 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:05.596721 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ec6c0abb-a1a9-4c66-85b3-a34aebf28e57 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:05.597838 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ec6c0abb-a1a9-4c66-85b3-a34aebf28e57 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:05.598827 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ec6c0abb-a1a9-4c66-85b3-a34aebf28e57 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:05.599322 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ec6c0abb-a1a9-4c66-85b3-a34aebf28e57 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:05.603212 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-868e2d3e-02b1-45e9-9216-8210d8545ed0 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:05.608777 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-868e2d3e-02b1-45e9-9216-8210d8545ed0 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:05.610816 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-868e2d3e-02b1-45e9-9216-8210d8545ed0 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:05.611460 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-868e2d3e-02b1-45e9-9216-8210d8545ed0 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:05.612251 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-868e2d3e-02b1-45e9-9216-8210d8545ed0 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:05.612680 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-868e2d3e-02b1-45e9-9216-8210d8545ed0 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:05.779865 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-868e2d3e-02b1-45e9-9216-8210d8545ed0 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:05.793667 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-868e2d3e-02b1-45e9-9216-8210d8545ed0 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94" status: 200 len: 1365 microversion: 2.1 time: 0.195048 Jun 14 18:32:05.794264 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 311/653] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:05 2022] GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94 => generated 1365 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:32:05.795377 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-ec6c0abb-a1a9-4c66-85b3-a34aebf28e57 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:05.799285 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-31fc5119-1d09-453e-92b8-25a4c6321c53 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:05.800913 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-31fc5119-1d09-453e-92b8-25a4c6321c53 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:05.807457 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-ec6c0abb-a1a9-4c66-85b3-a34aebf28e57 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:05.808466 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-31fc5119-1d09-453e-92b8-25a4c6321c53 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:05.808893 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-31fc5119-1d09-453e-92b8-25a4c6321c53 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:05.809214 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-ec6c0abb-a1a9-4c66-85b3-a34aebf28e57 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:05.809713 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-31fc5119-1d09-453e-92b8-25a4c6321c53 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:05.810371 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-31fc5119-1d09-453e-92b8-25a4c6321c53 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:05.810521 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-ec6c0abb-a1a9-4c66-85b3-a34aebf28e57 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1407 microversion: 2.20 time: 0.226024 Jun 14 18:32:05.810777 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 343/654] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:32:05 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:32:05.846884 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-31fc5119-1d09-453e-92b8-25a4c6321c53 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051245 Jun 14 18:32:05.847376 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 312/655] 10.222.0.78 () {58 vars in 1301 bytes} [Tue Jun 14 18:32:05 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 14 18:32:05.954362 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-cc9dc117-8d8e-4113-b84a-452af3cee45d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:05.954624 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-cc9dc117-8d8e-4113-b84a-452af3cee45d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:05.963507 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-cc9dc117-8d8e-4113-b84a-452af3cee45d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:05.964012 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-cc9dc117-8d8e-4113-b84a-452af3cee45d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:05.964770 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-cc9dc117-8d8e-4113-b84a-452af3cee45d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:05.965378 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-cc9dc117-8d8e-4113-b84a-452af3cee45d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:05.995113 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-cc9dc117-8d8e-4113-b84a-452af3cee45d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Going to try to terminate instance {{(pid=118624) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:32:06.215217 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-6c8edbec-b08a-4c56-9793-7c655de3945e req-8f39145a-6f12-45ce-97ec-923724ba88a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "678e536c-8e80-49f6-90d0-72aec54c7c94", "tag": "93a39948-07fb-4640-aa06-c4c42c36d5f1"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:32:06.224502 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-6c8edbec-b08a-4c56-9793-7c655de3945e req-8f39145a-6f12-45ce-97ec-923724ba88a3 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:06.225147 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-6c8edbec-b08a-4c56-9793-7c655de3945e req-8f39145a-6f12-45ce-97ec-923724ba88a3 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:06.246801 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-6c8edbec-b08a-4c56-9793-7c655de3945e req-8f39145a-6f12-45ce-97ec-923724ba88a3 service nova] Creating event network-changed:93a39948-07fb-4640-aa06-c4c42c36d5f1 for instance 678e536c-8e80-49f6-90d0-72aec54c7c94 on hv-cinder-84456 Jun 14 18:32:06.254532 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-6c8edbec-b08a-4c56-9793-7c655de3945e req-8f39145a-6f12-45ce-97ec-923724ba88a3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043965 Jun 14 18:32:06.255152 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 313/656] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:32:06.326955 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-cc9dc117-8d8e-4113-b84a-452af3cee45d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 204 len: 0 microversion: 2.1 time: 0.381497 Jun 14 18:32:06.332624 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 344/657] 10.222.0.78 () {58 vars in 1238 bytes} [Tue Jun 14 18:32:05 2022] DELETE /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 18:32:06.343867 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-f78e9e2c-790a-408f-9ee6-24bfcf158cc8 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:06.345164 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-f78e9e2c-790a-408f-9ee6-24bfcf158cc8 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:06.354577 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f78e9e2c-790a-408f-9ee6-24bfcf158cc8 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:06.355400 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f78e9e2c-790a-408f-9ee6-24bfcf158cc8 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:06.356192 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f78e9e2c-790a-408f-9ee6-24bfcf158cc8 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:06.356803 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f78e9e2c-790a-408f-9ee6-24bfcf158cc8 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:06.505639 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-f78e9e2c-790a-408f-9ee6-24bfcf158cc8 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:06.514277 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-f78e9e2c-790a-408f-9ee6-24bfcf158cc8 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1687 microversion: 2.1 time: 0.179616 Jun 14 18:32:06.514861 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 314/658] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:06 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1687 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:32:06.526041 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-68d9300a-8c52-4885-8433-5219e24097e4 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:06.527138 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-68d9300a-8c52-4885-8433-5219e24097e4 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 41923641-5855-4385-8905-cc7dc5a46714] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:06.533523 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-68d9300a-8c52-4885-8433-5219e24097e4 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:06.533975 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-68d9300a-8c52-4885-8433-5219e24097e4 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:06.534783 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-68d9300a-8c52-4885-8433-5219e24097e4 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:06.535217 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-68d9300a-8c52-4885-8433-5219e24097e4 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:06.681193 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-68d9300a-8c52-4885-8433-5219e24097e4 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:06.689151 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-68d9300a-8c52-4885-8433-5219e24097e4 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714" status: 200 len: 1363 microversion: 2.1 time: 0.168135 Jun 14 18:32:06.689991 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 345/659] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:06 2022] GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:32:06.811057 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-22e6fdf8-66dc-4cb1-9d53-dbff44c9dffb tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:06.811707 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-22e6fdf8-66dc-4cb1-9d53-dbff44c9dffb tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:06.813708 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:32:06.818815 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-22e6fdf8-66dc-4cb1-9d53-dbff44c9dffb tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:06.822443 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-22e6fdf8-66dc-4cb1-9d53-dbff44c9dffb tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:06.822443 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-22e6fdf8-66dc-4cb1-9d53-dbff44c9dffb tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:06.822443 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-22e6fdf8-66dc-4cb1-9d53-dbff44c9dffb tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:06.832094 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-bef9cdfd-4d4c-4139-822c-670daec89928 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:06.833215 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-bef9cdfd-4d4c-4139-822c-670daec89928 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:06.844510 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-bef9cdfd-4d4c-4139-822c-670daec89928 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:06.845300 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-bef9cdfd-4d4c-4139-822c-670daec89928 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:06.846359 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-bef9cdfd-4d4c-4139-822c-670daec89928 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:06.847196 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-bef9cdfd-4d4c-4139-822c-670daec89928 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:06.963709 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-22e6fdf8-66dc-4cb1-9d53-dbff44c9dffb tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:06.971519 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-22e6fdf8-66dc-4cb1-9d53-dbff44c9dffb tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94" status: 200 len: 1365 microversion: 2.1 time: 0.164307 Jun 14 18:32:06.972133 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 315/660] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:06 2022] GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:32:06.998777 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-bef9cdfd-4d4c-4139-822c-670daec89928 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:07.007244 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-bef9cdfd-4d4c-4139-822c-670daec89928 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:07.009702 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-bef9cdfd-4d4c-4139-822c-670daec89928 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:07.010983 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-bef9cdfd-4d4c-4139-822c-670daec89928 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1600 microversion: 2.20 time: 0.186204 Jun 14 18:32:07.011554 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 346/661] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:32:06 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1600 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:32:07.028536 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-af7f67c6-2727-4b91-998f-e84fc482df77 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:07.029034 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-af7f67c6-2727-4b91-998f-e84fc482df77 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:07.035406 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-af7f67c6-2727-4b91-998f-e84fc482df77 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:07.035854 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-af7f67c6-2727-4b91-998f-e84fc482df77 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:07.036634 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-af7f67c6-2727-4b91-998f-e84fc482df77 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:07.037066 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-af7f67c6-2727-4b91-998f-e84fc482df77 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:07.138142 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-af7f67c6-2727-4b91-998f-e84fc482df77 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.113492 Jun 14 18:32:07.138738 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 316/662] 10.222.0.78 () {60 vars in 1315 bytes} [Tue Jun 14 18:32:07 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b/os-interface => generated 285 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 14 18:32:07.533232 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-bd86867f-96b9-425e-b60a-6ebd25c3f539 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:07.533942 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-bd86867f-96b9-425e-b60a-6ebd25c3f539 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:07.542468 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-bd86867f-96b9-425e-b60a-6ebd25c3f539 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:07.542924 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-bd86867f-96b9-425e-b60a-6ebd25c3f539 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:07.543730 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-bd86867f-96b9-425e-b60a-6ebd25c3f539 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:07.544171 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-bd86867f-96b9-425e-b60a-6ebd25c3f539 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:07.696037 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-bd86867f-96b9-425e-b60a-6ebd25c3f539 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:07.704011 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-bd86867f-96b9-425e-b60a-6ebd25c3f539 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1687 microversion: 2.1 time: 0.175754 Jun 14 18:32:07.705483 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 347/663] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:07 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1687 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:32:07.709324 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-5cfb577e-5f81-43a0-9c30-c2ba93552f7d tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:07.710764 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-5cfb577e-5f81-43a0-9c30-c2ba93552f7d tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 41923641-5855-4385-8905-cc7dc5a46714] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:07.717354 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5cfb577e-5f81-43a0-9c30-c2ba93552f7d tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:07.718037 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5cfb577e-5f81-43a0-9c30-c2ba93552f7d tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:07.718801 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5cfb577e-5f81-43a0-9c30-c2ba93552f7d tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:07.719238 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5cfb577e-5f81-43a0-9c30-c2ba93552f7d tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:07.742141 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:32:07.988419 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-707c41b1-64d2-4688-929b-ef230a1c4a17 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:07.989146 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-707c41b1-64d2-4688-929b-ef230a1c4a17 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:07.997387 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-707c41b1-64d2-4688-929b-ef230a1c4a17 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:07.998011 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-707c41b1-64d2-4688-929b-ef230a1c4a17 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:07.998870 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-707c41b1-64d2-4688-929b-ef230a1c4a17 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:07.999390 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-707c41b1-64d2-4688-929b-ef230a1c4a17 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:08.018824 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-5cfb577e-5f81-43a0-9c30-c2ba93552f7d tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:08.029268 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-5cfb577e-5f81-43a0-9c30-c2ba93552f7d tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714" status: 200 len: 1363 microversion: 2.1 time: 0.324995 Jun 14 18:32:08.030025 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 317/664] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:07 2022] GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714 => generated 1363 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:32:08.159724 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-707c41b1-64d2-4688-929b-ef230a1c4a17 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:08.168721 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-707c41b1-64d2-4688-929b-ef230a1c4a17 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94" status: 200 len: 1365 microversion: 2.1 time: 0.184331 Jun 14 18:32:08.169312 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 348/665] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:07 2022] GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94 => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:32:08.327752 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-afa5b4ea-06f2-4e22-9205-84e91bbacb77 req-0219fdb7-343f-451a-99e7-26e8fecea532 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86678293-5e78-4bb0-9bc8-0a02da6d1a0b", "tag": "9a48c21f-378c-4db8-a26f-6ed7263009cb"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:32:08.336740 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-afa5b4ea-06f2-4e22-9205-84e91bbacb77 req-0219fdb7-343f-451a-99e7-26e8fecea532 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:08.337181 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-afa5b4ea-06f2-4e22-9205-84e91bbacb77 req-0219fdb7-343f-451a-99e7-26e8fecea532 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:08.350376 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-afa5b4ea-06f2-4e22-9205-84e91bbacb77 req-0219fdb7-343f-451a-99e7-26e8fecea532 service nova] Creating event network-changed:9a48c21f-378c-4db8-a26f-6ed7263009cb for instance 86678293-5e78-4bb0-9bc8-0a02da6d1a0b on hv-cinder-84456 Jun 14 18:32:08.355777 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-afa5b4ea-06f2-4e22-9205-84e91bbacb77 req-0219fdb7-343f-451a-99e7-26e8fecea532 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032012 Jun 14 18:32:08.356371 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 318/666] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:32:08.722408 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-6b564ccd-023b-4b2a-ab23-98e1fceee720 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:08.723374 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-6b564ccd-023b-4b2a-ab23-98e1fceee720 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:08.729919 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6b564ccd-023b-4b2a-ab23-98e1fceee720 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:08.730379 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6b564ccd-023b-4b2a-ab23-98e1fceee720 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:08.731115 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6b564ccd-023b-4b2a-ab23-98e1fceee720 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:08.731547 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6b564ccd-023b-4b2a-ab23-98e1fceee720 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:08.735683 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:32:08.876312 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-6b564ccd-023b-4b2a-ab23-98e1fceee720 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:08.885049 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-6b564ccd-023b-4b2a-ab23-98e1fceee720 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1687 microversion: 2.1 time: 0.166553 Jun 14 18:32:08.885680 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 349/667] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:08 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:32:09.049235 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-25b2d145-26ff-4a76-8fe8-6c13dc79a1ae tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:09.049993 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-25b2d145-26ff-4a76-8fe8-6c13dc79a1ae tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 41923641-5855-4385-8905-cc7dc5a46714] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:09.057013 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-25b2d145-26ff-4a76-8fe8-6c13dc79a1ae tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:09.057486 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-25b2d145-26ff-4a76-8fe8-6c13dc79a1ae tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:09.058269 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-25b2d145-26ff-4a76-8fe8-6c13dc79a1ae tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:09.058711 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-25b2d145-26ff-4a76-8fe8-6c13dc79a1ae tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:09.186968 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-d83df27f-cdc8-4254-8593-7fcc12b9c47d tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:09.187578 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-d83df27f-cdc8-4254-8593-7fcc12b9c47d tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:09.194681 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d83df27f-cdc8-4254-8593-7fcc12b9c47d tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:09.195468 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d83df27f-cdc8-4254-8593-7fcc12b9c47d tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:09.196423 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d83df27f-cdc8-4254-8593-7fcc12b9c47d tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:09.196887 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d83df27f-cdc8-4254-8593-7fcc12b9c47d tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:09.197850 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-25b2d145-26ff-4a76-8fe8-6c13dc79a1ae tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:09.205972 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-25b2d145-26ff-4a76-8fe8-6c13dc79a1ae tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714" status: 200 len: 1363 microversion: 2.1 time: 0.161287 Jun 14 18:32:09.206549 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 319/668] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:09 2022] GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:32:09.336353 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-d83df27f-cdc8-4254-8593-7fcc12b9c47d tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:09.343895 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-d83df27f-cdc8-4254-8593-7fcc12b9c47d tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94" status: 200 len: 1365 microversion: 2.1 time: 0.161349 Jun 14 18:32:09.344563 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 350/669] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:09 2022] GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:32:09.904048 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-000861e4-f1db-48c3-a4bc-20a6c8de987f tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:09.904753 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-000861e4-f1db-48c3-a4bc-20a6c8de987f tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:09.911196 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-000861e4-f1db-48c3-a4bc-20a6c8de987f tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:09.914823 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-000861e4-f1db-48c3-a4bc-20a6c8de987f tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:09.914823 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-000861e4-f1db-48c3-a4bc-20a6c8de987f tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:09.914823 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-000861e4-f1db-48c3-a4bc-20a6c8de987f tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:10.080405 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-000861e4-f1db-48c3-a4bc-20a6c8de987f tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:10.088738 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-000861e4-f1db-48c3-a4bc-20a6c8de987f tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1687 microversion: 2.1 time: 0.189456 Jun 14 18:32:10.089301 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 320/670] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:09 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1687 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:32:10.224010 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-d3126c1e-bc0f-4a20-9eb2-68993872afc0 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:10.224887 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-d3126c1e-bc0f-4a20-9eb2-68993872afc0 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 41923641-5855-4385-8905-cc7dc5a46714] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:10.232239 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d3126c1e-bc0f-4a20-9eb2-68993872afc0 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:10.232687 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d3126c1e-bc0f-4a20-9eb2-68993872afc0 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:10.233481 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d3126c1e-bc0f-4a20-9eb2-68993872afc0 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:10.233945 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d3126c1e-bc0f-4a20-9eb2-68993872afc0 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:10.364735 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-c3bc151e-7b75-4753-89a3-5361f47a7f26 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:10.366814 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-c3bc151e-7b75-4753-89a3-5361f47a7f26 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:10.375305 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c3bc151e-7b75-4753-89a3-5361f47a7f26 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:10.377639 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c3bc151e-7b75-4753-89a3-5361f47a7f26 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:10.377639 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c3bc151e-7b75-4753-89a3-5361f47a7f26 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:10.377639 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c3bc151e-7b75-4753-89a3-5361f47a7f26 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:10.556915 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-d3126c1e-bc0f-4a20-9eb2-68993872afc0 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:10.578213 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-d3126c1e-bc0f-4a20-9eb2-68993872afc0 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714" status: 200 len: 1363 microversion: 2.1 time: 0.352196 Jun 14 18:32:10.579464 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 351/671] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:10 2022] GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714 => generated 1363 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:32:10.595232 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell0:SELECT=4 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:32:10.618445 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell0:SELECT=20 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:32:10.668040 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-c3bc151e-7b75-4753-89a3-5361f47a7f26 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:10.677825 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-c3bc151e-7b75-4753-89a3-5361f47a7f26 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94" status: 200 len: 1365 microversion: 2.1 time: 0.319261 Jun 14 18:32:10.678666 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 321/672] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:10 2022] GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94 => generated 1365 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:32:11.105648 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-4447c1b4-9f18-4473-97b5-0501b3f50910 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:11.106434 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-4447c1b4-9f18-4473-97b5-0501b3f50910 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:11.115822 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell0:SELECT=16 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:32:11.123759 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4447c1b4-9f18-4473-97b5-0501b3f50910 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:11.124628 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4447c1b4-9f18-4473-97b5-0501b3f50910 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:11.128944 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4447c1b4-9f18-4473-97b5-0501b3f50910 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:11.130192 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4447c1b4-9f18-4473-97b5-0501b3f50910 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:11.276730 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-4447c1b4-9f18-4473-97b5-0501b3f50910 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:11.285775 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-4447c1b4-9f18-4473-97b5-0501b3f50910 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1620 microversion: 2.1 time: 0.184150 Jun 14 18:32:11.296495 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 352/673] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:11 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1620 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:32:11.602277 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-6ade06c4-9bd5-4adf-9377-53a1beee6b1b tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:11.604356 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-6ade06c4-9bd5-4adf-9377-53a1beee6b1b tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 41923641-5855-4385-8905-cc7dc5a46714] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:11.619343 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6ade06c4-9bd5-4adf-9377-53a1beee6b1b tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:11.620226 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6ade06c4-9bd5-4adf-9377-53a1beee6b1b tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:11.623313 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6ade06c4-9bd5-4adf-9377-53a1beee6b1b tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:11.625927 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6ade06c4-9bd5-4adf-9377-53a1beee6b1b tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:11.643698 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-14841da6-99b2-4715-bf22-ed55ab57e1be req-b277ccb4-d1ca-4e70-9619-42c30694f1e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e66ffa48-038e-40ba-b075-bafc9eb4b015", "name": "network-vif-deleted", "tag": "6e99f823-8a81-4709-b6d7-f5393c08507e"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:32:11.654543 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-14841da6-99b2-4715-bf22-ed55ab57e1be req-b277ccb4-d1ca-4e70-9619-42c30694f1e2 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:11.655691 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-14841da6-99b2-4715-bf22-ed55ab57e1be req-b277ccb4-d1ca-4e70-9619-42c30694f1e2 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:11.671890 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-14841da6-99b2-4715-bf22-ed55ab57e1be req-b277ccb4-d1ca-4e70-9619-42c30694f1e2 service nova] Creating event network-vif-deleted:6e99f823-8a81-4709-b6d7-f5393c08507e for instance e66ffa48-038e-40ba-b075-bafc9eb4b015 on hv-cinder-84456 Jun 14 18:32:11.679325 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-14841da6-99b2-4715-bf22-ed55ab57e1be req-b277ccb4-d1ca-4e70-9619-42c30694f1e2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041938 Jun 14 18:32:11.681386 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 353/674] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:32:11.710510 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-334c55cb-0953-4aee-83e8-1818ff454a30 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:11.711677 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-334c55cb-0953-4aee-83e8-1818ff454a30 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:11.718466 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-334c55cb-0953-4aee-83e8-1818ff454a30 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:11.719128 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-334c55cb-0953-4aee-83e8-1818ff454a30 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:11.720140 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-334c55cb-0953-4aee-83e8-1818ff454a30 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:11.720775 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-334c55cb-0953-4aee-83e8-1818ff454a30 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:11.806136 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-6ade06c4-9bd5-4adf-9377-53a1beee6b1b tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:11.814314 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-6ade06c4-9bd5-4adf-9377-53a1beee6b1b tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714" status: 200 len: 1549 microversion: 2.1 time: 0.221675 Jun 14 18:32:11.826095 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 322/675] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:11 2022] GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714 => generated 1549 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:32:11.831589 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-e4342737-9464-4833-a1de-6f60df38c576 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:11.832168 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-e4342737-9464-4833-a1de-6f60df38c576 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 41923641-5855-4385-8905-cc7dc5a46714] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:11.839286 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e4342737-9464-4833-a1de-6f60df38c576 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:11.839951 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e4342737-9464-4833-a1de-6f60df38c576 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:11.840909 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e4342737-9464-4833-a1de-6f60df38c576 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:11.841529 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e4342737-9464-4833-a1de-6f60df38c576 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:11.874758 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-334c55cb-0953-4aee-83e8-1818ff454a30 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:11.883916 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-334c55cb-0953-4aee-83e8-1818ff454a30 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94" status: 200 len: 1365 microversion: 2.1 time: 0.184201 Jun 14 18:32:11.894554 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 354/676] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:11 2022] GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94 => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:32:11.923649 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-e4342737-9464-4833-a1de-6f60df38c576 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096098 Jun 14 18:32:11.924272 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 323/677] 10.222.0.78 () {58 vars in 1274 bytes} [Tue Jun 14 18:32:11 2022] GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:32:12.303530 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-675872d2-d449-4e20-939a-0cc5fd39675f tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:12.305242 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-675872d2-d449-4e20-939a-0cc5fd39675f tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:12.312863 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-675872d2-d449-4e20-939a-0cc5fd39675f tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:12.313610 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-675872d2-d449-4e20-939a-0cc5fd39675f tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:12.314414 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-675872d2-d449-4e20-939a-0cc5fd39675f tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:12.315131 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-675872d2-d449-4e20-939a-0cc5fd39675f tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:12.386084 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-675872d2-d449-4e20-939a-0cc5fd39675f tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:12.394015 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-675872d2-d449-4e20-939a-0cc5fd39675f tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1329 microversion: 2.1 time: 0.094282 Jun 14 18:32:12.404656 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 355/678] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:12 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1329 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:32:12.902119 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-7e412a41-7c85-47ba-b95a-c3cae0fb6e74 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:12.903121 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-7e412a41-7c85-47ba-b95a-c3cae0fb6e74 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:12.910188 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7e412a41-7c85-47ba-b95a-c3cae0fb6e74 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:12.911989 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7e412a41-7c85-47ba-b95a-c3cae0fb6e74 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:12.913750 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7e412a41-7c85-47ba-b95a-c3cae0fb6e74 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:12.914251 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7e412a41-7c85-47ba-b95a-c3cae0fb6e74 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:13.096316 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-7e412a41-7c85-47ba-b95a-c3cae0fb6e74 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:13.103956 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-7e412a41-7c85-47ba-b95a-c3cae0fb6e74 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94" status: 200 len: 1365 microversion: 2.1 time: 0.206976 Jun 14 18:32:13.104760 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 324/679] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:12 2022] GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94 => generated 1365 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:32:13.416693 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-15e50d82-fe2e-4813-b269-16c4336a529b tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:13.417785 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-15e50d82-fe2e-4813-b269-16c4336a529b tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:13.429823 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-15e50d82-fe2e-4813-b269-16c4336a529b tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:13.430953 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-15e50d82-fe2e-4813-b269-16c4336a529b tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:13.432586 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-15e50d82-fe2e-4813-b269-16c4336a529b tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:13.433365 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-15e50d82-fe2e-4813-b269-16c4336a529b tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:13.480747 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-15e50d82-fe2e-4813-b269-16c4336a529b tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:13.481194 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-15e50d82-fe2e-4813-b269-16c4336a529b tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:13.481677 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.objects.instance [None req-15e50d82-fe2e-4813-b269-16c4336a529b tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lazy-loading 'fault' on Instance uuid e66ffa48-038e-40ba-b075-bafc9eb4b015 {{(pid=118624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:32:13.530231 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-15e50d82-fe2e-4813-b269-16c4336a529b tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:13.537278 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-15e50d82-fe2e-4813-b269-16c4336a529b tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 200 len: 1334 microversion: 2.1 time: 0.128907 Jun 14 18:32:13.537879 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 356/680] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:13 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 1334 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:32:13.695024 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-b0614711-9915-4531-b5f0-fe77629451d2 req-2dc391ce-f08b-4a23-87ef-d092cf317c9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41923641-5855-4385-8905-cc7dc5a46714", "tag": "1754f2cd-b7cf-4e61-9902-e19aa00b1cb0"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:32:13.703366 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-b0614711-9915-4531-b5f0-fe77629451d2 req-2dc391ce-f08b-4a23-87ef-d092cf317c9c service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:13.703804 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-b0614711-9915-4531-b5f0-fe77629451d2 req-2dc391ce-f08b-4a23-87ef-d092cf317c9c service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:13.714920 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-b0614711-9915-4531-b5f0-fe77629451d2 req-2dc391ce-f08b-4a23-87ef-d092cf317c9c service nova] Creating event network-changed:1754f2cd-b7cf-4e61-9902-e19aa00b1cb0 for instance 41923641-5855-4385-8905-cc7dc5a46714 on hv-cinder-84456 Jun 14 18:32:13.720012 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-b0614711-9915-4531-b5f0-fe77629451d2 req-2dc391ce-f08b-4a23-87ef-d092cf317c9c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029117 Jun 14 18:32:13.720601 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 325/681] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:32:14.121247 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-cf04574b-298c-467a-990d-a7e6dbae5b72 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:14.121969 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-cf04574b-298c-467a-990d-a7e6dbae5b72 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:14.128593 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-cf04574b-298c-467a-990d-a7e6dbae5b72 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:14.129111 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-cf04574b-298c-467a-990d-a7e6dbae5b72 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:14.140179 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-cf04574b-298c-467a-990d-a7e6dbae5b72 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:14.140179 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-cf04574b-298c-467a-990d-a7e6dbae5b72 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:14.348836 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-cf04574b-298c-467a-990d-a7e6dbae5b72 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:14.356527 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-cf04574b-298c-467a-990d-a7e6dbae5b72 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94" status: 200 len: 1365 microversion: 2.1 time: 0.239700 Jun 14 18:32:14.357108 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 357/682] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:14 2022] GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94 => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:32:14.555505 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-76cc7adc-e11f-4bff-a7f7-fc8b47b02706 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:14.556110 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-76cc7adc-e11f-4bff-a7f7-fc8b47b02706 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: e66ffa48-038e-40ba-b075-bafc9eb4b015] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:14.562313 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-76cc7adc-e11f-4bff-a7f7-fc8b47b02706 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:14.562755 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-76cc7adc-e11f-4bff-a7f7-fc8b47b02706 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:14.563499 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-76cc7adc-e11f-4bff-a7f7-fc8b47b02706 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:14.563931 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-76cc7adc-e11f-4bff-a7f7-fc8b47b02706 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:14.577793 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.wsgi [None req-76cc7adc-e11f-4bff-a7f7-fc8b47b02706 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] HTTP exception thrown: Instance e66ffa48-038e-40ba-b075-bafc9eb4b015 could not be found. Jun 14 18:32:14.579399 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-76cc7adc-e11f-4bff-a7f7-fc8b47b02706 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Request method failure captured: Jun 14 18:32:14.579399 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: request: GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 HTTP/1.1 Jun 14 18:32:14.579399 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept: application/json Jun 14 18:32:14.579399 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept-Encoding: identity Jun 14 18:32:14.579399 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Connection: close Jun 14 18:32:14.579399 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Length: 0 Jun 14 18:32:14.579399 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Type: application/json Jun 14 18:32:14.579399 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Host: 10.222.0.78 Jun 14 18:32:14.579399 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Openstack-System-Scope: None Jun 14 18:32:14.579399 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: User-Agent: python-urllib3/1.26.9 Jun 14 18:32:14.579399 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Auth-Token: gAAAAABiqNMLmsc67uKqI-N-C_X_FhrUcqjTvgCN_KzDpDCXteEoTPgrRoD6Ywb_SWbZmcccxpWD5TO2tWjenTUuj22mzrGN0E1HFTTIaMbUD5cHq7A5utVjIauxMwF4xyAg3dOi-qAU6NI2QSJxQv20Gtu9ypjDarfFBE2B0JV-w4G2UG_jGvU Jun 14 18:32:14.579399 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Id: None Jun 14 18:32:14.579399 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Name: None Jun 14 18:32:14.579399 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Identity-Status: Confirmed Jun 14 18:32:14.579399 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Is-Admin-Project: True Jun 14 18:32:14.579399 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Id: default Jun 14 18:32:14.579399 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Name: Default Jun 14 18:32:14.579399 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Id: a5c99e2733b440cc99c9749761f4b4cd Jun 14 18:32:14.579399 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2012041525 Jun 14 18:32:14.579399 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Role: reader,member Jun 14 18:32:14.579399 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Roles: reader,member Jun 14 18:32:14.580868 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a5c99e2733b440cc99c9749761f4b4cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a5c99e2733b440cc99c9749761f4b4cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a5c99e2733b440cc99c9749761f4b4cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a5c99e2733b440cc99c9749761f4b4cd"}]}] Jun 14 18:32:14.580868 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2012041525 Jun 14 18:32:14.580868 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Id: a5c99e2733b440cc99c9749761f4b4cd Jun 14 18:32:14.580868 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2012041525 Jun 14 18:32:14.580868 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User: tempest-ServerRescueNegativeTestJSON-2012041525-project Jun 14 18:32:14.580868 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Id: default Jun 14 18:32:14.580868 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Name: Default Jun 14 18:32:14.580868 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Id: 7bf1c044cb3843b4a54edd75a3f04685 Jun 14 18:32:14.580868 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2012041525-project Jun 14 18:32:14.580868 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: method: > Jun 14 18:32:14.580868 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: exception: Instance e66ffa48-038e-40ba-b075-bafc9eb4b015 could not be found. Jun 14 18:32:14.580868 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: action_args: {'id': 'e66ffa48-038e-40ba-b075-bafc9eb4b015'} Jun 14 18:32:14.581747 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:32:14.581747 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:32:14.581747 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:32:14.581747 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:32:14.581747 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:32:14.581747 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:32:14.581747 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:32:14.581747 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:32:14.581747 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:32:14.581747 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:32:14.581747 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e66ffa48-038e-40ba-b075-bafc9eb4b015 could not be found. Jun 14 18:32:14.581747 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:32:14.581747 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:32:14.581747 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:32:14.581747 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:32:14.581747 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:32:14.581747 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:32:14.581747 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:32:14.581747 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:32:14.581747 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:32:14.583124 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:32:14.583124 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:32:14.583124 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:32:14.583124 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:32:14.583124 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:32:14.583124 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:32:14.583124 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:32:14.583124 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e66ffa48-038e-40ba-b075-bafc9eb4b015 could not be found. Jun 14 18:32:14.583124 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:32:14.583124 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:32:14.583124 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:32:14.583124 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:32:14.583124 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:32:14.583124 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:32:14.583124 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:32:14.583124 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:32:14.583124 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e66ffa48-038e-40ba-b075-bafc9eb4b015 could not be found. Jun 14 18:32:14.583124 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:32:14.584370 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-76cc7adc-e11f-4bff-a7f7-fc8b47b02706 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Returning 404 to user: Instance e66ffa48-038e-40ba-b075-bafc9eb4b015 could not be found. {{(pid=118623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:32:14.584370 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-76cc7adc-e11f-4bff-a7f7-fc8b47b02706 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015" status: 404 len: 111 microversion: 2.1 time: 0.030226 Jun 14 18:32:14.584370 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 326/683] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:14 2022] GET /compute/v2.1/servers/e66ffa48-038e-40ba-b075-bafc9eb4b015 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:32:14.590182 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-e52511ca-3d6b-4647-b667-a44061c98824 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '.version_select at 0x7efe70188040>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:14.672084 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-e52511ca-3d6b-4647-b667-a44061c98824 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-843213200" status: 202 len: 0 microversion: 2.1 time: 0.085660 Jun 14 18:32:14.672668 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 358/684] 10.222.0.78 () {58 vars in 1217 bytes} [Tue Jun 14 18:32:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-843213200 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:32:15.373657 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-88361c95-0114-41d7-ace6-65bc17db795d tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:15.374289 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-88361c95-0114-41d7-ace6-65bc17db795d tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:15.380469 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-88361c95-0114-41d7-ace6-65bc17db795d tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:15.380917 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-88361c95-0114-41d7-ace6-65bc17db795d tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:15.381830 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-88361c95-0114-41d7-ace6-65bc17db795d tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:15.382327 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-88361c95-0114-41d7-ace6-65bc17db795d tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:15.525877 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-88361c95-0114-41d7-ace6-65bc17db795d tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:15.533980 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-88361c95-0114-41d7-ace6-65bc17db795d tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94" status: 200 len: 1365 microversion: 2.1 time: 0.164146 Jun 14 18:32:15.534636 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 327/685] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:15 2022] GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:32:16.560549 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-7dcfd491-bf89-4e15-840c-5f472ec14752 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:16.561151 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-7dcfd491-bf89-4e15-840c-5f472ec14752 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:16.568547 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7dcfd491-bf89-4e15-840c-5f472ec14752 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:16.568999 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7dcfd491-bf89-4e15-840c-5f472ec14752 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:16.570541 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7dcfd491-bf89-4e15-840c-5f472ec14752 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:16.571115 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7dcfd491-bf89-4e15-840c-5f472ec14752 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:16.704658 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-7dcfd491-bf89-4e15-840c-5f472ec14752 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:16.712289 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-7dcfd491-bf89-4e15-840c-5f472ec14752 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94" status: 200 len: 1365 microversion: 2.1 time: 0.156212 Jun 14 18:32:16.712867 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 359/686] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:16 2022] GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:32:17.215908 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-9d9cede8-6349-42f2-a242-b35c524a5ff8 req-043d4a80-2fb0-4183-9b03-689c5ffed4f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "678e536c-8e80-49f6-90d0-72aec54c7c94", "name": "network-vif-plugged", "status": "completed", "tag": "93a39948-07fb-4640-aa06-c4c42c36d5f1"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:32:17.224600 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-9d9cede8-6349-42f2-a242-b35c524a5ff8 req-043d4a80-2fb0-4183-9b03-689c5ffed4f0 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:17.225046 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-9d9cede8-6349-42f2-a242-b35c524a5ff8 req-043d4a80-2fb0-4183-9b03-689c5ffed4f0 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:17.237620 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-9d9cede8-6349-42f2-a242-b35c524a5ff8 req-043d4a80-2fb0-4183-9b03-689c5ffed4f0 service nova] Creating event network-vif-plugged:93a39948-07fb-4640-aa06-c4c42c36d5f1 for instance 678e536c-8e80-49f6-90d0-72aec54c7c94 on hv-cinder-84456 Jun 14 18:32:17.242592 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-9d9cede8-6349-42f2-a242-b35c524a5ff8 req-043d4a80-2fb0-4183-9b03-689c5ffed4f0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030449 Jun 14 18:32:17.243182 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 328/687] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:32:17.730188 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-e9df45cb-44dd-4556-9d28-ada6297154a5 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:17.730792 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-e9df45cb-44dd-4556-9d28-ada6297154a5 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:17.737264 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e9df45cb-44dd-4556-9d28-ada6297154a5 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:17.737737 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e9df45cb-44dd-4556-9d28-ada6297154a5 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:17.738492 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e9df45cb-44dd-4556-9d28-ada6297154a5 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:17.738921 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e9df45cb-44dd-4556-9d28-ada6297154a5 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:17.871367 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-e9df45cb-44dd-4556-9d28-ada6297154a5 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:17.879463 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-e9df45cb-44dd-4556-9d28-ada6297154a5 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94" status: 200 len: 1365 microversion: 2.1 time: 0.153762 Jun 14 18:32:17.880034 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 360/688] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:17 2022] GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:32:17.981388 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-32ec5acb-fb4f-4cc4-bcfc-498fa059a66d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:17.982351 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-32ec5acb-fb4f-4cc4-bcfc-498fa059a66d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:17.988872 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-32ec5acb-fb4f-4cc4-bcfc-498fa059a66d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:17.989315 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-32ec5acb-fb4f-4cc4-bcfc-498fa059a66d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:17.990116 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-32ec5acb-fb4f-4cc4-bcfc-498fa059a66d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:17.990575 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-32ec5acb-fb4f-4cc4-bcfc-498fa059a66d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:18.017475 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-32ec5acb-fb4f-4cc4-bcfc-498fa059a66d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Going to try to terminate instance {{(pid=118623) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:32:18.328315 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-32ec5acb-fb4f-4cc4-bcfc-498fa059a66d tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "DELETE /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 204 len: 0 microversion: 2.1 time: 0.351085 Jun 14 18:32:18.329007 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 329/689] 10.222.0.78 () {58 vars in 1238 bytes} [Tue Jun 14 18:32:17 2022] DELETE /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 18:32:18.336930 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-166fca38-f08f-46a7-ae88-b387b14a30e3 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:18.337561 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-166fca38-f08f-46a7-ae88-b387b14a30e3 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:18.343676 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-166fca38-f08f-46a7-ae88-b387b14a30e3 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:18.344123 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-166fca38-f08f-46a7-ae88-b387b14a30e3 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:18.344881 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-166fca38-f08f-46a7-ae88-b387b14a30e3 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:18.345310 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-166fca38-f08f-46a7-ae88-b387b14a30e3 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:18.485685 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-166fca38-f08f-46a7-ae88-b387b14a30e3 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:18.493424 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-166fca38-f08f-46a7-ae88-b387b14a30e3 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1507 microversion: 2.1 time: 0.160353 Jun 14 18:32:18.494017 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 361/690] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:18 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:32:18.897937 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-61162959-b452-4a0c-9b76-842f6e8a0ddc tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:18.899324 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-61162959-b452-4a0c-9b76-842f6e8a0ddc tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:18.905588 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-61162959-b452-4a0c-9b76-842f6e8a0ddc tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:18.906033 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-61162959-b452-4a0c-9b76-842f6e8a0ddc tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:18.906801 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-61162959-b452-4a0c-9b76-842f6e8a0ddc tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:18.907227 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-61162959-b452-4a0c-9b76-842f6e8a0ddc tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:19.061331 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-61162959-b452-4a0c-9b76-842f6e8a0ddc tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:19.076127 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-61162959-b452-4a0c-9b76-842f6e8a0ddc tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94" status: 200 len: 1365 microversion: 2.1 time: 0.182034 Jun 14 18:32:19.077196 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 330/691] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:18 2022] GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94 => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:32:19.511320 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-39ae7547-7c71-4c43-9297-6f6ea4c05e5c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:19.511956 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-39ae7547-7c71-4c43-9297-6f6ea4c05e5c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:19.518597 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-39ae7547-7c71-4c43-9297-6f6ea4c05e5c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:19.519041 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-39ae7547-7c71-4c43-9297-6f6ea4c05e5c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:19.519813 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-39ae7547-7c71-4c43-9297-6f6ea4c05e5c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:19.520242 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-39ae7547-7c71-4c43-9297-6f6ea4c05e5c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:19.656026 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-39ae7547-7c71-4c43-9297-6f6ea4c05e5c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:19.664841 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-39ae7547-7c71-4c43-9297-6f6ea4c05e5c tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1507 microversion: 2.1 time: 0.157990 Jun 14 18:32:19.665720 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 362/692] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:19 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:32:20.094976 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-d104463f-eaf6-4bb1-ad0d-0e83b473a1d8 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:20.095572 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-d104463f-eaf6-4bb1-ad0d-0e83b473a1d8 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:20.102798 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d104463f-eaf6-4bb1-ad0d-0e83b473a1d8 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:20.103239 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d104463f-eaf6-4bb1-ad0d-0e83b473a1d8 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:20.103994 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d104463f-eaf6-4bb1-ad0d-0e83b473a1d8 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:20.104431 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d104463f-eaf6-4bb1-ad0d-0e83b473a1d8 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:20.239846 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-d104463f-eaf6-4bb1-ad0d-0e83b473a1d8 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:20.247726 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-d104463f-eaf6-4bb1-ad0d-0e83b473a1d8 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94" status: 200 len: 1365 microversion: 2.1 time: 0.156703 Jun 14 18:32:20.248307 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 331/693] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:20 2022] GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:32:20.682455 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-8e9b7b2b-4b1d-4562-8bbb-48ad2ffd6836 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:20.683064 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-8e9b7b2b-4b1d-4562-8bbb-48ad2ffd6836 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:20.689768 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8e9b7b2b-4b1d-4562-8bbb-48ad2ffd6836 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:20.690217 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8e9b7b2b-4b1d-4562-8bbb-48ad2ffd6836 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:20.691032 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8e9b7b2b-4b1d-4562-8bbb-48ad2ffd6836 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:20.691464 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8e9b7b2b-4b1d-4562-8bbb-48ad2ffd6836 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:20.821923 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-8e9b7b2b-4b1d-4562-8bbb-48ad2ffd6836 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:20.829577 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-8e9b7b2b-4b1d-4562-8bbb-48ad2ffd6836 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1507 microversion: 2.1 time: 0.151224 Jun 14 18:32:20.830145 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 363/694] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:20 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:32:21.264217 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-077fd458-b53f-4e57-b077-5e4a60af4fa4 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:21.264779 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-077fd458-b53f-4e57-b077-5e4a60af4fa4 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:21.271334 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-077fd458-b53f-4e57-b077-5e4a60af4fa4 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:21.271781 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-077fd458-b53f-4e57-b077-5e4a60af4fa4 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:21.272571 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-077fd458-b53f-4e57-b077-5e4a60af4fa4 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:21.273033 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-077fd458-b53f-4e57-b077-5e4a60af4fa4 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:21.411156 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-077fd458-b53f-4e57-b077-5e4a60af4fa4 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:21.419503 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-077fd458-b53f-4e57-b077-5e4a60af4fa4 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94" status: 200 len: 1554 microversion: 2.1 time: 0.159204 Jun 14 18:32:21.420175 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 332/695] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:21 2022] GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:32:21.436570 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-c94c2da5-dfd1-442c-99e4-03cb1b087681 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:21.437100 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-c94c2da5-dfd1-442c-99e4-03cb1b087681 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:21.443165 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c94c2da5-dfd1-442c-99e4-03cb1b087681 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:21.443606 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c94c2da5-dfd1-442c-99e4-03cb1b087681 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:21.444413 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c94c2da5-dfd1-442c-99e4-03cb1b087681 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:21.444816 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c94c2da5-dfd1-442c-99e4-03cb1b087681 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:21.777648 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-c94c2da5-dfd1-442c-99e4-03cb1b087681 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.124423 Jun 14 18:32:21.777648 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 364/696] 10.222.0.78 () {58 vars in 1274 bytes} [Tue Jun 14 18:32:21 2022] GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:32:21.847639 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-39342f65-137f-407f-9641-c5bb7a0ba209 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:21.848213 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-39342f65-137f-407f-9641-c5bb7a0ba209 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:21.855047 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-39342f65-137f-407f-9641-c5bb7a0ba209 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:21.855486 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-39342f65-137f-407f-9641-c5bb7a0ba209 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:21.856248 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-39342f65-137f-407f-9641-c5bb7a0ba209 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:21.856677 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-39342f65-137f-407f-9641-c5bb7a0ba209 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:22.108323 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-39342f65-137f-407f-9641-c5bb7a0ba209 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:22.117764 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-39342f65-137f-407f-9641-c5bb7a0ba209 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1507 microversion: 2.1 time: 0.274697 Jun 14 18:32:22.118545 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 333/697] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:21 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1507 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:32:22.242642 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-3123ad83-4dd8-4827-8310-d71a72ae65f5 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2137036214"}} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:32:22.243320 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-3123ad83-4dd8-4827-8310-d71a72ae65f5 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:22.245485 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:32:22.251501 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3123ad83-4dd8-4827-8310-d71a72ae65f5 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:22.252089 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3123ad83-4dd8-4827-8310-d71a72ae65f5 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:22.253237 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3123ad83-4dd8-4827-8310-d71a72ae65f5 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:22.253719 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3123ad83-4dd8-4827-8310-d71a72ae65f5 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:22.366074 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-4f539640-b61e-4123-b6cb-879d6fc50bc1 req-9d856511-319f-47b2-8f41-8406e0cbca62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee", "name": "network-vif-deleted", "tag": "dcaeaf29-4f8b-4d99-8c22-29b129b65a8c"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:32:22.375891 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-4f539640-b61e-4123-b6cb-879d6fc50bc1 req-9d856511-319f-47b2-8f41-8406e0cbca62 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:22.376638 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-4f539640-b61e-4123-b6cb-879d6fc50bc1 req-9d856511-319f-47b2-8f41-8406e0cbca62 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:22.388939 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-4f539640-b61e-4123-b6cb-879d6fc50bc1 req-9d856511-319f-47b2-8f41-8406e0cbca62 service nova] Creating event network-vif-deleted:dcaeaf29-4f8b-4d99-8c22-29b129b65a8c for instance 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee on hv-cinder-84456 Jun 14 18:32:22.398095 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-4f539640-b61e-4123-b6cb-879d6fc50bc1 req-9d856511-319f-47b2-8f41-8406e0cbca62 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032916 Jun 14 18:32:22.398095 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 334/698] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:32:22.458050 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.network.security_group_api [None req-3123ad83-4dd8-4827-8310-d71a72ae65f5 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Removing security group a043ae42-832d-4072-8ca0-33689f176a66 from port 9530bd2f-adfe-4346-b9ff-e6d39d227b3c Jun 14 18:32:23.138845 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-75b857d6-d85d-436f-a3a6-ac011b43c226 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:23.139574 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-75b857d6-d85d-436f-a3a6-ac011b43c226 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:23.148416 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-3123ad83-4dd8-4827-8310-d71a72ae65f5 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "POST /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd/action" status: 202 len: 0 microversion: 2.1 time: 0.910849 Jun 14 18:32:23.148988 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-75b857d6-d85d-436f-a3a6-ac011b43c226 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:23.149417 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-75b857d6-d85d-436f-a3a6-ac011b43c226 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:23.150627 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-75b857d6-d85d-436f-a3a6-ac011b43c226 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:23.151488 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 365/699] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Jun 14 18:32:22 2022] POST /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd/action => generated 0 bytes in 915 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:32:23.152757 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-75b857d6-d85d-436f-a3a6-ac011b43c226 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:23.208512 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-75b857d6-d85d-436f-a3a6-ac011b43c226 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:23.209214 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-75b857d6-d85d-436f-a3a6-ac011b43c226 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:23.213898 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.objects.instance [None req-75b857d6-d85d-436f-a3a6-ac011b43c226 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lazy-loading 'fault' on Instance uuid 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee {{(pid=118623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:32:23.279349 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-bc846099-3ef6-442a-b96b-d21468d0f472 req-e5c5d8f3-9e97-4f83-bd78-f8838f3b83e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "678e536c-8e80-49f6-90d0-72aec54c7c94", "tag": "93a39948-07fb-4640-aa06-c4c42c36d5f1"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:32:23.291522 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-75b857d6-d85d-436f-a3a6-ac011b43c226 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:23.302275 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:32:23.306215 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-75b857d6-d85d-436f-a3a6-ac011b43c226 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 200 len: 1311 microversion: 2.1 time: 0.172501 Jun 14 18:32:23.310374 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 335/700] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:23 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 1311 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:32:23.322191 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-bc846099-3ef6-442a-b96b-d21468d0f472 req-e5c5d8f3-9e97-4f83-bd78-f8838f3b83e1 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:23.325331 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-bc846099-3ef6-442a-b96b-d21468d0f472 req-e5c5d8f3-9e97-4f83-bd78-f8838f3b83e1 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:23.356387 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-bc846099-3ef6-442a-b96b-d21468d0f472 req-e5c5d8f3-9e97-4f83-bd78-f8838f3b83e1 service nova] Creating event network-changed:93a39948-07fb-4640-aa06-c4c42c36d5f1 for instance 678e536c-8e80-49f6-90d0-72aec54c7c94 on hv-cinder-84456 Jun 14 18:32:23.381010 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-bc846099-3ef6-442a-b96b-d21468d0f472 req-e5c5d8f3-9e97-4f83-bd78-f8838f3b83e1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.216617 Jun 14 18:32:23.388417 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 366/701] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:32:24.394502 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-4704a7ca-120c-4e96-ba26-6c51a124ee30 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:24.395200 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-4704a7ca-120c-4e96-ba26-6c51a124ee30 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:24.401836 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4704a7ca-120c-4e96-ba26-6c51a124ee30 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:24.402593 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4704a7ca-120c-4e96-ba26-6c51a124ee30 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:24.403993 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4704a7ca-120c-4e96-ba26-6c51a124ee30 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:24.404631 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4704a7ca-120c-4e96-ba26-6c51a124ee30 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:24.414333 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-432f4095-e63e-49d2-af90-749603474970 req-bb098ff2-5185-4803-8394-c9a57cbdcbb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "023acd67-717e-45ef-abd2-936d81bbbccd", "tag": "9530bd2f-adfe-4346-b9ff-e6d39d227b3c"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:32:24.425049 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-432f4095-e63e-49d2-af90-749603474970 req-bb098ff2-5185-4803-8394-c9a57cbdcbb7 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:24.425825 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-432f4095-e63e-49d2-af90-749603474970 req-bb098ff2-5185-4803-8394-c9a57cbdcbb7 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:24.439604 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-432f4095-e63e-49d2-af90-749603474970 req-bb098ff2-5185-4803-8394-c9a57cbdcbb7 service nova] Creating event network-changed:9530bd2f-adfe-4346-b9ff-e6d39d227b3c for instance 023acd67-717e-45ef-abd2-936d81bbbccd on hv-cinder-84456 Jun 14 18:32:24.445608 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-432f4095-e63e-49d2-af90-749603474970 req-bb098ff2-5185-4803-8394-c9a57cbdcbb7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037338 Jun 14 18:32:24.446432 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 367/702] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:32:24.454844 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-f51d79ce-833e-4659-8756-efbfd33185df tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:24.455673 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-f51d79ce-833e-4659-8756-efbfd33185df tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:24.456752 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.wsgi [None req-4704a7ca-120c-4e96-ba26-6c51a124ee30 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] HTTP exception thrown: Instance 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee could not be found. Jun 14 18:32:24.458542 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-4704a7ca-120c-4e96-ba26-6c51a124ee30 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Request method failure captured: Jun 14 18:32:24.458542 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: request: GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee HTTP/1.1 Jun 14 18:32:24.458542 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept: application/json Jun 14 18:32:24.458542 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept-Encoding: identity Jun 14 18:32:24.458542 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Connection: close Jun 14 18:32:24.458542 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Length: 0 Jun 14 18:32:24.458542 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Type: application/json Jun 14 18:32:24.458542 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Host: 10.222.0.78 Jun 14 18:32:24.458542 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Openstack-System-Scope: None Jun 14 18:32:24.458542 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: User-Agent: python-urllib3/1.26.9 Jun 14 18:32:24.458542 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Auth-Token: gAAAAABiqNMLmsc67uKqI-N-C_X_FhrUcqjTvgCN_KzDpDCXteEoTPgrRoD6Ywb_SWbZmcccxpWD5TO2tWjenTUuj22mzrGN0E1HFTTIaMbUD5cHq7A5utVjIauxMwF4xyAg3dOi-qAU6NI2QSJxQv20Gtu9ypjDarfFBE2B0JV-w4G2UG_jGvU Jun 14 18:32:24.458542 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Id: None Jun 14 18:32:24.458542 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Name: None Jun 14 18:32:24.458542 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Identity-Status: Confirmed Jun 14 18:32:24.458542 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Is-Admin-Project: True Jun 14 18:32:24.458542 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Id: default Jun 14 18:32:24.458542 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Name: Default Jun 14 18:32:24.458542 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Id: a5c99e2733b440cc99c9749761f4b4cd Jun 14 18:32:24.458542 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2012041525 Jun 14 18:32:24.458542 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Role: reader,member Jun 14 18:32:24.458542 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Roles: reader,member Jun 14 18:32:24.461002 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a5c99e2733b440cc99c9749761f4b4cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a5c99e2733b440cc99c9749761f4b4cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a5c99e2733b440cc99c9749761f4b4cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a5c99e2733b440cc99c9749761f4b4cd"}]}] Jun 14 18:32:24.461002 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2012041525 Jun 14 18:32:24.461002 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Id: a5c99e2733b440cc99c9749761f4b4cd Jun 14 18:32:24.461002 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2012041525 Jun 14 18:32:24.461002 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User: tempest-ServerRescueNegativeTestJSON-2012041525-project Jun 14 18:32:24.461002 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Id: default Jun 14 18:32:24.461002 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Name: Default Jun 14 18:32:24.461002 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Id: 7bf1c044cb3843b4a54edd75a3f04685 Jun 14 18:32:24.461002 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2012041525-project Jun 14 18:32:24.461002 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: method: > Jun 14 18:32:24.461002 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: exception: Instance 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee could not be found. Jun 14 18:32:24.461002 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: action_args: {'id': '118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee'} Jun 14 18:32:24.461951 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:32:24.461951 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:32:24.461951 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:32:24.461951 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:32:24.461951 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:32:24.461951 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:32:24.461951 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:32:24.461951 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:32:24.461951 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:32:24.461951 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:32:24.461951 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee could not be found. Jun 14 18:32:24.461951 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:32:24.461951 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:32:24.461951 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:32:24.461951 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:32:24.461951 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:32:24.461951 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:32:24.461951 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:32:24.461951 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:32:24.461951 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:32:24.463424 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:32:24.463424 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:32:24.463424 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:32:24.463424 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:32:24.463424 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:32:24.463424 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:32:24.463424 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:32:24.463424 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee could not be found. Jun 14 18:32:24.463424 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:32:24.463424 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:32:24.463424 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:32:24.463424 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:32:24.463424 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:32:24.463424 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:32:24.463424 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:32:24.463424 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:32:24.463424 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee could not be found. Jun 14 18:32:24.463424 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:32:24.464763 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-4704a7ca-120c-4e96-ba26-6c51a124ee30 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Returning 404 to user: Instance 118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee could not be found. {{(pid=118623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:32:24.464853 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f51d79ce-833e-4659-8756-efbfd33185df tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:24.464853 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f51d79ce-833e-4659-8756-efbfd33185df tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:24.465032 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-4704a7ca-120c-4e96-ba26-6c51a124ee30 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee" status: 404 len: 111 microversion: 2.1 time: 0.139812 Jun 14 18:32:24.465125 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f51d79ce-833e-4659-8756-efbfd33185df tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:24.465125 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f51d79ce-833e-4659-8756-efbfd33185df tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:24.469810 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 336/703] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:24 2022] GET /compute/v2.1/servers/118dd8fa-d3a4-4ea7-9a04-9c6338d5c3ee => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:32:24.478733 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-9a19abc2-7f12-4c65-bb49-f6069f757ffa tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:24.479233 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-9a19abc2-7f12-4c65-bb49-f6069f757ffa tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 99045096-d6ff-4e14-b710-1b1e2dd9a7c5] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:24.485645 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9a19abc2-7f12-4c65-bb49-f6069f757ffa tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:24.486127 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9a19abc2-7f12-4c65-bb49-f6069f757ffa tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:24.487033 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9a19abc2-7f12-4c65-bb49-f6069f757ffa tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:24.487474 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9a19abc2-7f12-4c65-bb49-f6069f757ffa tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:24.552352 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.objects.instance [None req-f51d79ce-833e-4659-8756-efbfd33185df tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lazy-loading 'services' on Instance uuid 023acd67-717e-45ef-abd2-936d81bbbccd {{(pid=118624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:32:24.552970 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-9a19abc2-7f12-4c65-bb49-f6069f757ffa tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 99045096-d6ff-4e14-b710-1b1e2dd9a7c5] Going to try to terminate instance {{(pid=118623) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:32:24.568118 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell1:SELECT=100 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:32:24.793597 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-f51d79ce-833e-4659-8756-efbfd33185df tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "DELETE /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd/os-volume_attachments/0610748b-27e4-4a36-abec-0fbe7bd14439" status: 202 len: 0 microversion: 2.1 time: 0.342903 Jun 14 18:32:24.795009 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 368/704] 10.222.0.78 () {58 vars in 1415 bytes} [Tue Jun 14 18:32:24 2022] DELETE /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd/os-volume_attachments/0610748b-27e4-4a36-abec-0fbe7bd14439 => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:32:24.827872 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-a1e89d3e-3066-4aec-b2ef-8c7bb2f2d956 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:24.828900 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-a1e89d3e-3066-4aec-b2ef-8c7bb2f2d956 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:24.848242 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a1e89d3e-3066-4aec-b2ef-8c7bb2f2d956 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:24.848693 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a1e89d3e-3066-4aec-b2ef-8c7bb2f2d956 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:24.849473 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a1e89d3e-3066-4aec-b2ef-8c7bb2f2d956 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:24.849910 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a1e89d3e-3066-4aec-b2ef-8c7bb2f2d956 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:24.899208 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-a1e89d3e-3066-4aec-b2ef-8c7bb2f2d956 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080031 Jun 14 18:32:24.901244 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 369/705] 10.222.0.78 () {58 vars in 1301 bytes} [Tue Jun 14 18:32:24 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:32:24.926292 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-9a19abc2-7f12-4c65-bb49-f6069f757ffa tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "DELETE /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5" status: 204 len: 0 microversion: 2.1 time: 0.451153 Jun 14 18:32:24.939015 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 337/706] 10.222.0.78 () {58 vars in 1238 bytes} [Tue Jun 14 18:32:24 2022] DELETE /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 18:32:24.939138 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-3c1939a6-a55e-4fcb-afd4-f5583b4e34d3 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:24.939138 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-3c1939a6-a55e-4fcb-afd4-f5583b4e34d3 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 99045096-d6ff-4e14-b710-1b1e2dd9a7c5] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:24.945249 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3c1939a6-a55e-4fcb-afd4-f5583b4e34d3 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:24.946226 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3c1939a6-a55e-4fcb-afd4-f5583b4e34d3 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:24.948435 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3c1939a6-a55e-4fcb-afd4-f5583b4e34d3 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:24.949072 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3c1939a6-a55e-4fcb-afd4-f5583b4e34d3 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:25.116377 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-3c1939a6-a55e-4fcb-afd4-f5583b4e34d3 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:25.123179 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-3c1939a6-a55e-4fcb-afd4-f5583b4e34d3 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5" status: 200 len: 1520 microversion: 2.1 time: 0.190777 Jun 14 18:32:25.124105 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 370/707] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:24 2022] GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5 => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:32:25.402830 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-c731e0ab-588f-4a80-a6be-49c789abb66e req-a814ce47-e05e-4527-8815-e5b4c8af9fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "023acd67-717e-45ef-abd2-936d81bbbccd", "tag": "9530bd2f-adfe-4346-b9ff-e6d39d227b3c"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:32:25.412274 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-c731e0ab-588f-4a80-a6be-49c789abb66e req-a814ce47-e05e-4527-8815-e5b4c8af9fc7 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:25.412729 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-c731e0ab-588f-4a80-a6be-49c789abb66e req-a814ce47-e05e-4527-8815-e5b4c8af9fc7 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:25.423997 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-c731e0ab-588f-4a80-a6be-49c789abb66e req-a814ce47-e05e-4527-8815-e5b4c8af9fc7 service nova] Creating event network-changed:9530bd2f-adfe-4346-b9ff-e6d39d227b3c for instance 023acd67-717e-45ef-abd2-936d81bbbccd on hv-cinder-84456 Jun 14 18:32:25.429783 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-c731e0ab-588f-4a80-a6be-49c789abb66e req-a814ce47-e05e-4527-8815-e5b4c8af9fc7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030822 Jun 14 18:32:25.430350 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 338/708] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:32:25.911087 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-a2fe635b-4e97-45a1-ae64-c08b17cd42cd tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:25.912046 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-a2fe635b-4e97-45a1-ae64-c08b17cd42cd tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:25.919522 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a2fe635b-4e97-45a1-ae64-c08b17cd42cd tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:25.919971 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a2fe635b-4e97-45a1-ae64-c08b17cd42cd tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:25.920730 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a2fe635b-4e97-45a1-ae64-c08b17cd42cd tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:25.921164 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a2fe635b-4e97-45a1-ae64-c08b17cd42cd tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:25.950560 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-a2fe635b-4e97-45a1-ae64-c08b17cd42cd tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043433 Jun 14 18:32:25.951132 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 371/709] 10.222.0.78 () {58 vars in 1301 bytes} [Tue Jun 14 18:32:25 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:32:26.141399 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-32bd9204-c1c2-4689-8133-0fb9d14db940 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:26.142106 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-32bd9204-c1c2-4689-8133-0fb9d14db940 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 99045096-d6ff-4e14-b710-1b1e2dd9a7c5] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:26.148944 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-32bd9204-c1c2-4689-8133-0fb9d14db940 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:26.149382 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-32bd9204-c1c2-4689-8133-0fb9d14db940 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:26.150158 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-32bd9204-c1c2-4689-8133-0fb9d14db940 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:26.150585 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-32bd9204-c1c2-4689-8133-0fb9d14db940 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:26.280071 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-32bd9204-c1c2-4689-8133-0fb9d14db940 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:26.287462 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-32bd9204-c1c2-4689-8133-0fb9d14db940 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5" status: 200 len: 1520 microversion: 2.1 time: 0.150367 Jun 14 18:32:26.288634 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 339/710] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:26 2022] GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:32:26.964237 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-b3ee8613-efc7-410f-8b27-0d4e8ef6947a tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:26.965174 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-b3ee8613-efc7-410f-8b27-0d4e8ef6947a tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:26.971578 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b3ee8613-efc7-410f-8b27-0d4e8ef6947a tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:26.972016 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b3ee8613-efc7-410f-8b27-0d4e8ef6947a tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:26.972770 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b3ee8613-efc7-410f-8b27-0d4e8ef6947a tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:26.973197 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b3ee8613-efc7-410f-8b27-0d4e8ef6947a tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:27.005744 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-b3ee8613-efc7-410f-8b27-0d4e8ef6947a tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045921 Jun 14 18:32:27.006298 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 372/711] 10.222.0.78 () {58 vars in 1301 bytes} [Tue Jun 14 18:32:26 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:32:27.305704 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-27e30343-1813-4ddd-b264-d098776be248 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:27.306313 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-27e30343-1813-4ddd-b264-d098776be248 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 99045096-d6ff-4e14-b710-1b1e2dd9a7c5] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:27.312713 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-27e30343-1813-4ddd-b264-d098776be248 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:27.313154 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-27e30343-1813-4ddd-b264-d098776be248 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:27.313983 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-27e30343-1813-4ddd-b264-d098776be248 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:27.314465 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-27e30343-1813-4ddd-b264-d098776be248 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:27.447808 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-27e30343-1813-4ddd-b264-d098776be248 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:27.455808 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-27e30343-1813-4ddd-b264-d098776be248 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5" status: 200 len: 1520 microversion: 2.1 time: 0.154695 Jun 14 18:32:27.456551 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 340/712] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:27 2022] GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:32:28.017438 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-a09053d2-b755-47b2-bfc6-ef0dec8a410f tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:28.018414 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-a09053d2-b755-47b2-bfc6-ef0dec8a410f tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:28.025179 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a09053d2-b755-47b2-bfc6-ef0dec8a410f tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:28.025665 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a09053d2-b755-47b2-bfc6-ef0dec8a410f tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:28.026429 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a09053d2-b755-47b2-bfc6-ef0dec8a410f tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:28.026862 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a09053d2-b755-47b2-bfc6-ef0dec8a410f tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:28.057527 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-a09053d2-b755-47b2-bfc6-ef0dec8a410f tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043973 Jun 14 18:32:28.058005 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 373/713] 10.222.0.78 () {58 vars in 1301 bytes} [Tue Jun 14 18:32:28 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:32:28.473977 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-5d1564b3-dd01-451f-a9e3-5d31405e798b tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:28.474683 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-5d1564b3-dd01-451f-a9e3-5d31405e798b tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 99045096-d6ff-4e14-b710-1b1e2dd9a7c5] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:28.482920 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5d1564b3-dd01-451f-a9e3-5d31405e798b tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:28.483697 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5d1564b3-dd01-451f-a9e3-5d31405e798b tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:28.484492 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5d1564b3-dd01-451f-a9e3-5d31405e798b tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:28.484925 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5d1564b3-dd01-451f-a9e3-5d31405e798b tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:28.620803 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-5d1564b3-dd01-451f-a9e3-5d31405e798b tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:28.628828 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-5d1564b3-dd01-451f-a9e3-5d31405e798b tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5" status: 200 len: 1520 microversion: 2.1 time: 0.158568 Jun 14 18:32:28.629415 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 341/714] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:28 2022] GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:32:29.068657 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-4084a99e-877e-493c-8116-c26c1db3a38a tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:29.070557 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-4084a99e-877e-493c-8116-c26c1db3a38a tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:29.077791 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4084a99e-877e-493c-8116-c26c1db3a38a tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:29.078248 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4084a99e-877e-493c-8116-c26c1db3a38a tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:29.079032 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4084a99e-877e-493c-8116-c26c1db3a38a tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:29.079470 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4084a99e-877e-493c-8116-c26c1db3a38a tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:29.138748 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-4084a99e-877e-493c-8116-c26c1db3a38a tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074185 Jun 14 18:32:29.139338 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 374/715] 10.222.0.78 () {58 vars in 1301 bytes} [Tue Jun 14 18:32:29 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 14 18:32:29.149943 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-fda62d6d-8c54-4baf-881c-572bc593ebdc tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:29.150434 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-fda62d6d-8c54-4baf-881c-572bc593ebdc tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:29.159260 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-fda62d6d-8c54-4baf-881c-572bc593ebdc tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:29.159709 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-fda62d6d-8c54-4baf-881c-572bc593ebdc tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:29.160793 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-fda62d6d-8c54-4baf-881c-572bc593ebdc tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:29.161228 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-fda62d6d-8c54-4baf-881c-572bc593ebdc tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:29.203280 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-82003fab-efb2-4161-a514-74362508c196 req-056f8cda-c19d-422b-a26d-f565337ca5ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99045096-d6ff-4e14-b710-1b1e2dd9a7c5", "name": "network-vif-deleted", "tag": "3f0e5739-b788-43f3-8405-75ad4766a788"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:32:29.219831 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-82003fab-efb2-4161-a514-74362508c196 req-056f8cda-c19d-422b-a26d-f565337ca5ef service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:29.219831 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-82003fab-efb2-4161-a514-74362508c196 req-056f8cda-c19d-422b-a26d-f565337ca5ef service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:29.246551 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.wsgi [None req-fda62d6d-8c54-4baf-881c-572bc593ebdc tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] HTTP exception thrown: Instance 023acd67-717e-45ef-abd2-936d81bbbccd is not attached to volume 0610748b-27e4-4a36-abec-0fbe7bd14439 Jun 14 18:32:29.249346 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-fda62d6d-8c54-4baf-881c-572bc593ebdc tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Request method failure captured: Jun 14 18:32:29.249346 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: request: DELETE /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd/os-volume_attachments/0610748b-27e4-4a36-abec-0fbe7bd14439 HTTP/1.1 Jun 14 18:32:29.249346 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept: application/json Jun 14 18:32:29.249346 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept-Encoding: identity Jun 14 18:32:29.249346 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Connection: close Jun 14 18:32:29.249346 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Length: 0 Jun 14 18:32:29.249346 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Type: application/json Jun 14 18:32:29.249346 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Host: 10.222.0.78 Jun 14 18:32:29.249346 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Openstack-System-Scope: None Jun 14 18:32:29.249346 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: User-Agent: python-urllib3/1.26.9 Jun 14 18:32:29.249346 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Auth-Token: gAAAAABiqNN_eJOBn89htj4UEyx_S1lN2bHcpJHItvYujcp3sqhju5Nt5PKaq1LN5IrHZkfsgyKuyzsaFuxrapT-gz-EXZ_VLggqNPCnTjfzAIyw0cQhBGTSzzbO_5NRDn_EyhXF29LmZ8Zbw7PeUec4ISMcSRFILAMa7ciOaN4NDgcLqGnmlTo Jun 14 18:32:29.249346 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Id: None Jun 14 18:32:29.249346 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Name: None Jun 14 18:32:29.249346 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Identity-Status: Confirmed Jun 14 18:32:29.249346 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Is-Admin-Project: True Jun 14 18:32:29.249346 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Id: default Jun 14 18:32:29.249346 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Name: Default Jun 14 18:32:29.249346 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Id: 54fd905313ed4581a527fe3a6ebf7bba Jun 14 18:32:29.249346 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Name: tempest-TestMinimumBasicScenario-796235676 Jun 14 18:32:29.249346 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Role: reader,member Jun 14 18:32:29.249346 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Roles: reader,member Jun 14 18:32:29.250898 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_54fd905313ed4581a527fe3a6ebf7bba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/54fd905313ed4581a527fe3a6ebf7bba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/54fd905313ed4581a527fe3a6ebf7bba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/54fd905313ed4581a527fe3a6ebf7bba"}]}] Jun 14 18:32:29.250898 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant: tempest-TestMinimumBasicScenario-796235676 Jun 14 18:32:29.250898 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Id: 54fd905313ed4581a527fe3a6ebf7bba Jun 14 18:32:29.250898 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Name: tempest-TestMinimumBasicScenario-796235676 Jun 14 18:32:29.250898 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User: tempest-TestMinimumBasicScenario-796235676-project Jun 14 18:32:29.250898 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Id: default Jun 14 18:32:29.250898 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Name: Default Jun 14 18:32:29.250898 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Id: d48cebe37030401a9907025fa097a44a Jun 14 18:32:29.250898 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Name: tempest-TestMinimumBasicScenario-796235676-project Jun 14 18:32:29.250898 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: method: > Jun 14 18:32:29.250898 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: exception: Instance 023acd67-717e-45ef-abd2-936d81bbbccd is not attached to volume 0610748b-27e4-4a36-abec-0fbe7bd14439 Jun 14 18:32:29.251674 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: action_args: {'server_id': '023acd67-717e-45ef-abd2-936d81bbbccd', 'id': '0610748b-27e4-4a36-abec-0fbe7bd14439'} Jun 14 18:32:29.251674 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:32:29.251674 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:32:29.251674 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 14 18:32:29.251674 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 14 18:32:29.251674 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 14 18:32:29.251674 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 14 18:32:29.251674 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 14 18:32:29.251674 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 14 18:32:29.251674 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0610748b-27e4-4a36-abec-0fbe7bd14439. Jun 14 18:32:29.251674 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:32:29.251674 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:32:29.251674 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:32:29.251674 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:32:29.251674 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:32:29.251674 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:32:29.251674 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:32:29.251674 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:32:29.251674 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:32:29.252975 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:32:29.252975 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 14 18:32:29.252975 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 14 18:32:29.252975 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 023acd67-717e-45ef-abd2-936d81bbbccd is not attached to volume 0610748b-27e4-4a36-abec-0fbe7bd14439 Jun 14 18:32:29.252975 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:32:29.252975 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:32:29.252975 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:32:29.252975 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:32:29.252975 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:32:29.252975 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:32:29.252975 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:32:29.252975 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:32:29.252975 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 023acd67-717e-45ef-abd2-936d81bbbccd is not attached to volume 0610748b-27e4-4a36-abec-0fbe7bd14439 Jun 14 18:32:29.252975 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:32:29.257142 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-fda62d6d-8c54-4baf-881c-572bc593ebdc tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Returning 404 to user: Instance 023acd67-717e-45ef-abd2-936d81bbbccd is not attached to volume 0610748b-27e4-4a36-abec-0fbe7bd14439 {{(pid=118623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:32:29.257142 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-fda62d6d-8c54-4baf-881c-572bc593ebdc tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "DELETE /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd/os-volume_attachments/0610748b-27e4-4a36-abec-0fbe7bd14439" status: 404 len: 154 microversion: 2.1 time: 0.109863 Jun 14 18:32:29.257142 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 342/716] 10.222.0.78 () {58 vars in 1415 bytes} [Tue Jun 14 18:32:29 2022] DELETE /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd/os-volume_attachments/0610748b-27e4-4a36-abec-0fbe7bd14439 => generated 154 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:32:29.385241 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-82003fab-efb2-4161-a514-74362508c196 req-056f8cda-c19d-422b-a26d-f565337ca5ef service nova] Creating event network-vif-deleted:3f0e5739-b788-43f3-8405-75ad4766a788 for instance 99045096-d6ff-4e14-b710-1b1e2dd9a7c5 on hv-cinder-84456 Jun 14 18:32:29.389957 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-82003fab-efb2-4161-a514-74362508c196 req-056f8cda-c19d-422b-a26d-f565337ca5ef service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190992 Jun 14 18:32:29.390560 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 375/717] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:32:29.646674 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-9ce1c1a1-8a25-4647-89aa-2657cfd9e2f0 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:29.647369 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-9ce1c1a1-8a25-4647-89aa-2657cfd9e2f0 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 99045096-d6ff-4e14-b710-1b1e2dd9a7c5] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:29.654077 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9ce1c1a1-8a25-4647-89aa-2657cfd9e2f0 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:29.654520 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9ce1c1a1-8a25-4647-89aa-2657cfd9e2f0 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:29.655302 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9ce1c1a1-8a25-4647-89aa-2657cfd9e2f0 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:29.655727 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9ce1c1a1-8a25-4647-89aa-2657cfd9e2f0 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:29.688137 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9ce1c1a1-8a25-4647-89aa-2657cfd9e2f0 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:29.688573 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9ce1c1a1-8a25-4647-89aa-2657cfd9e2f0 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:29.689078 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.objects.instance [None req-9ce1c1a1-8a25-4647-89aa-2657cfd9e2f0 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lazy-loading 'fault' on Instance uuid 99045096-d6ff-4e14-b710-1b1e2dd9a7c5 {{(pid=118623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:32:29.731428 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-9ce1c1a1-8a25-4647-89aa-2657cfd9e2f0 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf1c044cb3843b4a54edd75a3f04685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c99e2733b440cc99c9749761f4b4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:29.739037 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-9ce1c1a1-8a25-4647-89aa-2657cfd9e2f0 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5" status: 200 len: 1311 microversion: 2.1 time: 0.096416 Jun 14 18:32:29.739600 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 343/718] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:29 2022] GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5 => generated 1311 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:32:30.597905 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-5a443faa-474f-435b-9545-f7802a66ed65 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:30.598541 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-5a443faa-474f-435b-9545-f7802a66ed65 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:30.604613 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5a443faa-474f-435b-9545-f7802a66ed65 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:30.605057 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5a443faa-474f-435b-9545-f7802a66ed65 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:30.605838 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5a443faa-474f-435b-9545-f7802a66ed65 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:30.606265 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5a443faa-474f-435b-9545-f7802a66ed65 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:30.630006 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-5a443faa-474f-435b-9545-f7802a66ed65 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Going to try to terminate instance {{(pid=118624) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:32:30.755087 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-00c4bce7-2525-4563-a421-6b99d0f023b1 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:30.755722 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-00c4bce7-2525-4563-a421-6b99d0f023b1 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] [instance: 99045096-d6ff-4e14-b710-1b1e2dd9a7c5] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:30.763351 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-00c4bce7-2525-4563-a421-6b99d0f023b1 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:30.763827 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-00c4bce7-2525-4563-a421-6b99d0f023b1 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:30.764592 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-00c4bce7-2525-4563-a421-6b99d0f023b1 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:30.765030 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-00c4bce7-2525-4563-a421-6b99d0f023b1 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:30.778515 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.wsgi [None req-00c4bce7-2525-4563-a421-6b99d0f023b1 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] HTTP exception thrown: Instance 99045096-d6ff-4e14-b710-1b1e2dd9a7c5 could not be found. Jun 14 18:32:30.780069 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-00c4bce7-2525-4563-a421-6b99d0f023b1 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Request method failure captured: Jun 14 18:32:30.780069 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: request: GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5 HTTP/1.1 Jun 14 18:32:30.780069 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept: application/json Jun 14 18:32:30.780069 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept-Encoding: identity Jun 14 18:32:30.780069 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Connection: close Jun 14 18:32:30.780069 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Length: 0 Jun 14 18:32:30.780069 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Type: application/json Jun 14 18:32:30.780069 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Host: 10.222.0.78 Jun 14 18:32:30.780069 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Openstack-System-Scope: None Jun 14 18:32:30.780069 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: User-Agent: python-urllib3/1.26.9 Jun 14 18:32:30.780069 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Auth-Token: gAAAAABiqNMLmsc67uKqI-N-C_X_FhrUcqjTvgCN_KzDpDCXteEoTPgrRoD6Ywb_SWbZmcccxpWD5TO2tWjenTUuj22mzrGN0E1HFTTIaMbUD5cHq7A5utVjIauxMwF4xyAg3dOi-qAU6NI2QSJxQv20Gtu9ypjDarfFBE2B0JV-w4G2UG_jGvU Jun 14 18:32:30.780069 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Id: None Jun 14 18:32:30.780069 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Name: None Jun 14 18:32:30.780069 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Identity-Status: Confirmed Jun 14 18:32:30.780069 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Is-Admin-Project: True Jun 14 18:32:30.780069 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Id: default Jun 14 18:32:30.780069 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Name: Default Jun 14 18:32:30.780069 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Id: a5c99e2733b440cc99c9749761f4b4cd Jun 14 18:32:30.780069 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2012041525 Jun 14 18:32:30.780069 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Role: reader,member Jun 14 18:32:30.780069 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Roles: reader,member Jun 14 18:32:30.781587 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a5c99e2733b440cc99c9749761f4b4cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a5c99e2733b440cc99c9749761f4b4cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a5c99e2733b440cc99c9749761f4b4cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a5c99e2733b440cc99c9749761f4b4cd"}]}] Jun 14 18:32:30.781587 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2012041525 Jun 14 18:32:30.781587 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Id: a5c99e2733b440cc99c9749761f4b4cd Jun 14 18:32:30.781587 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2012041525 Jun 14 18:32:30.781587 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User: tempest-ServerRescueNegativeTestJSON-2012041525-project Jun 14 18:32:30.781587 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Id: default Jun 14 18:32:30.781587 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Name: Default Jun 14 18:32:30.781587 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Id: 7bf1c044cb3843b4a54edd75a3f04685 Jun 14 18:32:30.781587 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2012041525-project Jun 14 18:32:30.781587 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: method: > Jun 14 18:32:30.781587 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: exception: Instance 99045096-d6ff-4e14-b710-1b1e2dd9a7c5 could not be found. Jun 14 18:32:30.781587 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: action_args: {'id': '99045096-d6ff-4e14-b710-1b1e2dd9a7c5'} Jun 14 18:32:30.782426 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:32:30.782426 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:32:30.782426 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:32:30.782426 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:32:30.782426 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:32:30.782426 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:32:30.782426 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:32:30.782426 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:32:30.782426 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:32:30.782426 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:32:30.782426 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99045096-d6ff-4e14-b710-1b1e2dd9a7c5 could not be found. Jun 14 18:32:30.782426 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:32:30.782426 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:32:30.782426 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:32:30.782426 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:32:30.782426 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:32:30.782426 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:32:30.782426 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:32:30.782426 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:32:30.782426 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:32:30.783865 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:32:30.783865 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:32:30.783865 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:32:30.783865 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:32:30.783865 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:32:30.783865 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:32:30.783865 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:32:30.783865 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99045096-d6ff-4e14-b710-1b1e2dd9a7c5 could not be found. Jun 14 18:32:30.783865 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:32:30.783865 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:32:30.783865 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:32:30.783865 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:32:30.783865 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:32:30.783865 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:32:30.783865 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:32:30.783865 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:32:30.783865 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99045096-d6ff-4e14-b710-1b1e2dd9a7c5 could not be found. Jun 14 18:32:30.783865 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:32:30.785298 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-00c4bce7-2525-4563-a421-6b99d0f023b1 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] Returning 404 to user: Instance 99045096-d6ff-4e14-b710-1b1e2dd9a7c5 could not be found. {{(pid=118623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:32:30.785298 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-00c4bce7-2525-4563-a421-6b99d0f023b1 tempest-ServerRescueNegativeTestJSON-2012041525 tempest-ServerRescueNegativeTestJSON-2012041525-project] 10.222.0.78 "GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5" status: 404 len: 111 microversion: 2.1 time: 0.030324 Jun 14 18:32:30.785298 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 344/719] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:30 2022] GET /compute/v2.1/servers/99045096-d6ff-4e14-b710-1b1e2dd9a7c5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 14 18:32:30.922702 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-5a443faa-474f-435b-9545-f7802a66ed65 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "DELETE /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 204 len: 0 microversion: 2.1 time: 0.329091 Jun 14 18:32:30.923277 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 376/720] 10.222.0.78 () {58 vars in 1238 bytes} [Tue Jun 14 18:32:30 2022] DELETE /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 18:32:30.932030 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-5d00c0b7-16c1-42c2-b2f7-c3bda58459ed tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:30.932920 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-5d00c0b7-16c1-42c2-b2f7-c3bda58459ed tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:30.944630 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5d00c0b7-16c1-42c2-b2f7-c3bda58459ed tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:30.945090 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5d00c0b7-16c1-42c2-b2f7-c3bda58459ed tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:30.945917 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5d00c0b7-16c1-42c2-b2f7-c3bda58459ed tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:30.946355 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5d00c0b7-16c1-42c2-b2f7-c3bda58459ed tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:31.085993 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-5d00c0b7-16c1-42c2-b2f7-c3bda58459ed tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:31.093399 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-5d00c0b7-16c1-42c2-b2f7-c3bda58459ed tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1554 microversion: 2.1 time: 0.165860 Jun 14 18:32:31.093994 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 345/721] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:30 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:32:32.112268 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-ee386a19-b799-45c4-913a-5759b134c805 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:32.113070 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-ee386a19-b799-45c4-913a-5759b134c805 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:32.120530 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ee386a19-b799-45c4-913a-5759b134c805 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:32.120984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ee386a19-b799-45c4-913a-5759b134c805 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:32.121788 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ee386a19-b799-45c4-913a-5759b134c805 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:32.122261 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ee386a19-b799-45c4-913a-5759b134c805 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:32.563740 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-ee386a19-b799-45c4-913a-5759b134c805 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:32.573722 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-ee386a19-b799-45c4-913a-5759b134c805 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1554 microversion: 2.1 time: 0.465635 Jun 14 18:32:32.574535 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 377/722] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:32 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1554 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:32:33.551432 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-7e52b6f9-8de4-4029-a392-2d221fcf1506 req-1fe7c2e9-bc1c-4679-9254-e85f6bea6280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "023acd67-717e-45ef-abd2-936d81bbbccd", "name": "network-vif-deleted", "tag": "9530bd2f-adfe-4346-b9ff-e6d39d227b3c"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:32:33.565737 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-7e52b6f9-8de4-4029-a392-2d221fcf1506 req-1fe7c2e9-bc1c-4679-9254-e85f6bea6280 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:33.569390 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-7e52b6f9-8de4-4029-a392-2d221fcf1506 req-1fe7c2e9-bc1c-4679-9254-e85f6bea6280 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:33.595119 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-eeed779e-0f47-4628-8961-bf90fcca2414 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:33.595119 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-eeed779e-0f47-4628-8961-bf90fcca2414 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:33.602137 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-7e52b6f9-8de4-4029-a392-2d221fcf1506 req-1fe7c2e9-bc1c-4679-9254-e85f6bea6280 service nova] Creating event network-vif-deleted:9530bd2f-adfe-4346-b9ff-e6d39d227b3c for instance 023acd67-717e-45ef-abd2-936d81bbbccd on hv-cinder-84456 Jun 14 18:32:33.602694 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-eeed779e-0f47-4628-8961-bf90fcca2414 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:33.603141 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-eeed779e-0f47-4628-8961-bf90fcca2414 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:33.603917 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-eeed779e-0f47-4628-8961-bf90fcca2414 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:33.604346 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-eeed779e-0f47-4628-8961-bf90fcca2414 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:33.609004 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-7e52b6f9-8de4-4029-a392-2d221fcf1506 req-1fe7c2e9-bc1c-4679-9254-e85f6bea6280 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061879 Jun 14 18:32:33.610244 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 346/723] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:32:33.766663 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-eeed779e-0f47-4628-8961-bf90fcca2414 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd48cebe37030401a9907025fa097a44a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd905313ed4581a527fe3a6ebf7bba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:33.774611 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-eeed779e-0f47-4628-8961-bf90fcca2414 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 200 len: 1512 microversion: 2.1 time: 0.186900 Jun 14 18:32:33.775525 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 378/724] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:33 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 1512 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:32:34.797038 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-ccacc19d-ae01-4f57-a04f-307ef2fbdff9 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:34.799025 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-ccacc19d-ae01-4f57-a04f-307ef2fbdff9 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] [instance: 023acd67-717e-45ef-abd2-936d81bbbccd] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:34.810316 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ccacc19d-ae01-4f57-a04f-307ef2fbdff9 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:34.811227 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ccacc19d-ae01-4f57-a04f-307ef2fbdff9 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:34.812237 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ccacc19d-ae01-4f57-a04f-307ef2fbdff9 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:34.813993 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ccacc19d-ae01-4f57-a04f-307ef2fbdff9 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:34.835543 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.wsgi [None req-ccacc19d-ae01-4f57-a04f-307ef2fbdff9 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] HTTP exception thrown: Instance 023acd67-717e-45ef-abd2-936d81bbbccd could not be found. Jun 14 18:32:34.838344 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-ccacc19d-ae01-4f57-a04f-307ef2fbdff9 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Request method failure captured: Jun 14 18:32:34.838344 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: request: GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd HTTP/1.1 Jun 14 18:32:34.838344 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept: application/json Jun 14 18:32:34.838344 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept-Encoding: identity Jun 14 18:32:34.838344 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Connection: close Jun 14 18:32:34.838344 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Length: 0 Jun 14 18:32:34.838344 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Type: application/json Jun 14 18:32:34.838344 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Host: 10.222.0.78 Jun 14 18:32:34.838344 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Openstack-System-Scope: None Jun 14 18:32:34.838344 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: User-Agent: python-urllib3/1.26.9 Jun 14 18:32:34.838344 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Auth-Token: gAAAAABiqNN_eJOBn89htj4UEyx_S1lN2bHcpJHItvYujcp3sqhju5Nt5PKaq1LN5IrHZkfsgyKuyzsaFuxrapT-gz-EXZ_VLggqNPCnTjfzAIyw0cQhBGTSzzbO_5NRDn_EyhXF29LmZ8Zbw7PeUec4ISMcSRFILAMa7ciOaN4NDgcLqGnmlTo Jun 14 18:32:34.838344 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Id: None Jun 14 18:32:34.838344 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Name: None Jun 14 18:32:34.838344 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Identity-Status: Confirmed Jun 14 18:32:34.838344 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Is-Admin-Project: True Jun 14 18:32:34.838344 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Id: default Jun 14 18:32:34.838344 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Name: Default Jun 14 18:32:34.838344 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Id: 54fd905313ed4581a527fe3a6ebf7bba Jun 14 18:32:34.838344 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Name: tempest-TestMinimumBasicScenario-796235676 Jun 14 18:32:34.838344 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Role: reader,member Jun 14 18:32:34.838344 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Roles: reader,member Jun 14 18:32:34.839658 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_54fd905313ed4581a527fe3a6ebf7bba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/54fd905313ed4581a527fe3a6ebf7bba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/54fd905313ed4581a527fe3a6ebf7bba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/54fd905313ed4581a527fe3a6ebf7bba"}]}] Jun 14 18:32:34.839658 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant: tempest-TestMinimumBasicScenario-796235676 Jun 14 18:32:34.839658 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Id: 54fd905313ed4581a527fe3a6ebf7bba Jun 14 18:32:34.839658 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Name: tempest-TestMinimumBasicScenario-796235676 Jun 14 18:32:34.839658 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User: tempest-TestMinimumBasicScenario-796235676-project Jun 14 18:32:34.839658 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Id: default Jun 14 18:32:34.839658 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Name: Default Jun 14 18:32:34.839658 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Id: d48cebe37030401a9907025fa097a44a Jun 14 18:32:34.839658 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Name: tempest-TestMinimumBasicScenario-796235676-project Jun 14 18:32:34.839658 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: method: > Jun 14 18:32:34.839658 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: exception: Instance 023acd67-717e-45ef-abd2-936d81bbbccd could not be found. Jun 14 18:32:34.839658 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: action_args: {'id': '023acd67-717e-45ef-abd2-936d81bbbccd'} Jun 14 18:32:34.840635 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:32:34.840635 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:32:34.840635 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:32:34.840635 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:32:34.840635 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:32:34.840635 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:32:34.840635 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:32:34.840635 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:32:34.840635 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:32:34.840635 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:32:34.840635 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 023acd67-717e-45ef-abd2-936d81bbbccd could not be found. Jun 14 18:32:34.840635 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:32:34.840635 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:32:34.840635 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:32:34.840635 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:32:34.840635 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:32:34.840635 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:32:34.840635 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:32:34.840635 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:32:34.840635 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:32:34.843129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:32:34.843129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:32:34.843129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:32:34.843129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:32:34.843129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:32:34.843129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:32:34.843129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:32:34.843129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 023acd67-717e-45ef-abd2-936d81bbbccd could not be found. Jun 14 18:32:34.843129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:32:34.843129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:32:34.843129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:32:34.843129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:32:34.843129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:32:34.843129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:32:34.843129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:32:34.843129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:32:34.843129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 023acd67-717e-45ef-abd2-936d81bbbccd could not be found. Jun 14 18:32:34.843129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:32:34.847156 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-ccacc19d-ae01-4f57-a04f-307ef2fbdff9 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Returning 404 to user: Instance 023acd67-717e-45ef-abd2-936d81bbbccd could not be found. {{(pid=118623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:32:34.849760 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-ccacc19d-ae01-4f57-a04f-307ef2fbdff9 tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd" status: 404 len: 111 microversion: 2.1 time: 0.060566 Jun 14 18:32:34.855078 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 347/725] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:34 2022] GET /compute/v2.1/servers/023acd67-717e-45ef-abd2-936d81bbbccd => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:32:34.860995 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-db0a20b5-ea16-4308-a12f-44c70d7a1dda tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] Calling method '.version_select at 0x7efe704134c0>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:34.966684 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-db0a20b5-ea16-4308-a12f-44c70d7a1dda tempest-TestMinimumBasicScenario-796235676 tempest-TestMinimumBasicScenario-796235676-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-538505258" status: 202 len: 0 microversion: 2.1 time: 0.109775 Jun 14 18:32:34.967557 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 379/726] 10.222.0.78 () {58 vars in 1268 bytes} [Tue Jun 14 18:32:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-538505258 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:32:51.949009 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:32:51.949802 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:32:52.182561 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-a7dbae04-d24f-4ae0-a280-dc7c96346136 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:52.183085 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-a7dbae04-d24f-4ae0-a280-dc7c96346136 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:52.189618 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a7dbae04-d24f-4ae0-a280-dc7c96346136 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:52.190064 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a7dbae04-d24f-4ae0-a280-dc7c96346136 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:52.190892 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a7dbae04-d24f-4ae0-a280-dc7c96346136 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:52.191325 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a7dbae04-d24f-4ae0-a280-dc7c96346136 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:52.216413 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-a7dbae04-d24f-4ae0-a280-dc7c96346136 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b/ips" status: 200 len: 153 microversion: 2.20 time: 0.273157 Jun 14 18:32:52.217025 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 348/727] 10.222.0.78 () {60 vars in 1288 bytes} [Tue Jun 14 18:32:51 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b/ips => generated 153 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 14 18:32:54.424175 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell1:SELECT=66,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:32:54.424977 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:32:54.429085 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-660d67b7-f766-4cd7-93f3-f0734148dd0c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:32:54.430235 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-660d67b7-f766-4cd7-93f3-f0734148dd0c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:54.436133 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-660d67b7-f766-4cd7-93f3-f0734148dd0c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:54.436582 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-660d67b7-f766-4cd7-93f3-f0734148dd0c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:54.437501 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-660d67b7-f766-4cd7-93f3-f0734148dd0c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:54.437952 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-660d67b7-f766-4cd7-93f3-f0734148dd0c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:54.462028 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.objects.instance [None req-660d67b7-f766-4cd7-93f3-f0734148dd0c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lazy-loading 'flavor' on Instance uuid 86678293-5e78-4bb0-9bc8-0a02da6d1a0b {{(pid=118624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:32:55.072917 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-660d67b7-f766-4cd7-93f3-f0734148dd0c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "POST /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b/action" status: 202 len: 0 microversion: 2.20 time: 0.650251 Jun 14 18:32:55.074482 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 380/728] 10.222.0.78 () {62 vars in 1318 bytes} [Tue Jun 14 18:32:54 2022] POST /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b/action => generated 0 bytes in 653 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 14 18:32:55.085989 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-d0f7cddc-e50b-45f8-a3b9-6b8cb6ac81ff tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:55.087394 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-d0f7cddc-e50b-45f8-a3b9-6b8cb6ac81ff tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:55.095654 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d0f7cddc-e50b-45f8-a3b9-6b8cb6ac81ff tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:55.096107 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d0f7cddc-e50b-45f8-a3b9-6b8cb6ac81ff tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:55.096921 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d0f7cddc-e50b-45f8-a3b9-6b8cb6ac81ff tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:55.097365 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d0f7cddc-e50b-45f8-a3b9-6b8cb6ac81ff tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:55.248840 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-d0f7cddc-e50b-45f8-a3b9-6b8cb6ac81ff tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:55.257177 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-d0f7cddc-e50b-45f8-a3b9-6b8cb6ac81ff tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:55.258706 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-d0f7cddc-e50b-45f8-a3b9-6b8cb6ac81ff tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:55.259875 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-d0f7cddc-e50b-45f8-a3b9-6b8cb6ac81ff tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1725 microversion: 2.20 time: 0.178336 Jun 14 18:32:55.260425 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 349/729] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:32:55 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:32:56.280222 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-5b8942b2-bb59-47bb-88ca-da1542fe4199 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:56.280842 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-5b8942b2-bb59-47bb-88ca-da1542fe4199 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:56.288027 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5b8942b2-bb59-47bb-88ca-da1542fe4199 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:56.288477 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5b8942b2-bb59-47bb-88ca-da1542fe4199 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:56.289272 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5b8942b2-bb59-47bb-88ca-da1542fe4199 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:56.289741 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5b8942b2-bb59-47bb-88ca-da1542fe4199 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:56.432364 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-5b8942b2-bb59-47bb-88ca-da1542fe4199 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:56.441543 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-5b8942b2-bb59-47bb-88ca-da1542fe4199 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:56.443084 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-5b8942b2-bb59-47bb-88ca-da1542fe4199 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:56.444246 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-5b8942b2-bb59-47bb-88ca-da1542fe4199 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1725 microversion: 2.20 time: 0.169221 Jun 14 18:32:56.444794 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 381/730] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:32:56 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:32:56.639312 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-cfa4d3b2-ad54-4360-800d-5f386ce09757 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:56.639923 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-cfa4d3b2-ad54-4360-800d-5f386ce09757 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 41923641-5855-4385-8905-cc7dc5a46714] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:56.645858 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-cfa4d3b2-ad54-4360-800d-5f386ce09757 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:56.646303 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-cfa4d3b2-ad54-4360-800d-5f386ce09757 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:56.647052 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-cfa4d3b2-ad54-4360-800d-5f386ce09757 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:56.647514 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-cfa4d3b2-ad54-4360-800d-5f386ce09757 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:56.675187 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-cfa4d3b2-ad54-4360-800d-5f386ce09757 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714/ips" status: 200 len: 145 microversion: 2.1 time: 0.149268 Jun 14 18:32:56.675751 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 350/731] 10.222.0.78 () {58 vars in 1247 bytes} [Tue Jun 14 18:32:56 2022] GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714/ips => generated 145 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:32:57.463437 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-8b3c4446-7e76-4b32-8606-4b038d6d599a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:57.464919 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-8b3c4446-7e76-4b32-8606-4b038d6d599a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:57.472449 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8b3c4446-7e76-4b32-8606-4b038d6d599a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:57.472896 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8b3c4446-7e76-4b32-8606-4b038d6d599a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:57.473712 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8b3c4446-7e76-4b32-8606-4b038d6d599a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:57.474149 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8b3c4446-7e76-4b32-8606-4b038d6d599a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:57.618523 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-8b3c4446-7e76-4b32-8606-4b038d6d599a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:57.628893 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-8b3c4446-7e76-4b32-8606-4b038d6d599a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:57.630449 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-8b3c4446-7e76-4b32-8606-4b038d6d599a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:57.631644 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-8b3c4446-7e76-4b32-8606-4b038d6d599a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1725 microversion: 2.20 time: 0.172462 Jun 14 18:32:57.632206 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 382/732] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:32:57 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:32:58.328092 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-bd579bc9-9403-4408-9a23-566dc4752578 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8cbd24e-84de-4ad0-b181-46571c18b6d7"}} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:32:58.329383 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-bd579bc9-9403-4408-9a23-566dc4752578 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 41923641-5855-4385-8905-cc7dc5a46714] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:58.335673 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-bd579bc9-9403-4408-9a23-566dc4752578 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:58.336121 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-bd579bc9-9403-4408-9a23-566dc4752578 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:58.336920 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-bd579bc9-9403-4408-9a23-566dc4752578 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:58.337342 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-bd579bc9-9403-4408-9a23-566dc4752578 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:58.475566 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-cc1f8983-d232-49d2-940c-dd54fdb86a13 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:32:58.476108 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-cc1f8983-d232-49d2-940c-dd54fdb86a13 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:58.482775 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-cc1f8983-d232-49d2-940c-dd54fdb86a13 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:58.483263 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-cc1f8983-d232-49d2-940c-dd54fdb86a13 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:58.483984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-cc1f8983-d232-49d2-940c-dd54fdb86a13 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:58.484426 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-cc1f8983-d232-49d2-940c-dd54fdb86a13 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:58.506958 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.objects.instance [None req-cc1f8983-d232-49d2-940c-dd54fdb86a13 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lazy-loading 'flavor' on Instance uuid 750a5111-2788-46b6-aa18-57f7c1019d64 {{(pid=118624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:32:58.774404 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-cc1f8983-d232-49d2-940c-dd54fdb86a13 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "POST /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64/action" status: 202 len: 0 microversion: 2.1 time: 0.302685 Jun 14 18:32:58.775003 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 383/733] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Jun 14 18:32:58 2022] POST /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 14 18:32:58.781239 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-187ecd7d-59bd-4f4c-a656-bf3ad72707bc tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:58.781960 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-187ecd7d-59bd-4f4c-a656-bf3ad72707bc tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:58.789817 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-187ecd7d-59bd-4f4c-a656-bf3ad72707bc tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:58.791032 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-187ecd7d-59bd-4f4c-a656-bf3ad72707bc tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:58.791867 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-187ecd7d-59bd-4f4c-a656-bf3ad72707bc tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:58.792303 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-187ecd7d-59bd-4f4c-a656-bf3ad72707bc tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:58.934769 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-187ecd7d-59bd-4f4c-a656-bf3ad72707bc tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:58.943206 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-187ecd7d-59bd-4f4c-a656-bf3ad72707bc tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:58.944747 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-187ecd7d-59bd-4f4c-a656-bf3ad72707bc tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:58.946006 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-187ecd7d-59bd-4f4c-a656-bf3ad72707bc tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1725 microversion: 2.20 time: 0.169872 Jun 14 18:32:58.946567 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 384/734] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:32:58 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:32:58.951583 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-4887a5ee-857a-4715-85f8-5fdaff034183 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:58.952223 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-4887a5ee-857a-4715-85f8-5fdaff034183 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:58.959977 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4887a5ee-857a-4715-85f8-5fdaff034183 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:58.960435 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4887a5ee-857a-4715-85f8-5fdaff034183 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:58.961697 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4887a5ee-857a-4715-85f8-5fdaff034183 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:58.961697 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4887a5ee-857a-4715-85f8-5fdaff034183 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:59.101904 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-4887a5ee-857a-4715-85f8-5fdaff034183 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:32:59.110511 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-4887a5ee-857a-4715-85f8-5fdaff034183 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1569 microversion: 2.1 time: 0.162924 Jun 14 18:32:59.111086 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 385/735] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:32:58 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:32:59.149884 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-bd579bc9-9403-4408-9a23-566dc4752578 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "POST /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.825510 Jun 14 18:32:59.150821 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 351/736] 10.222.0.78 () {60 vars in 1322 bytes} [Tue Jun 14 18:32:58 2022] POST /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714/os-volume_attachments => generated 194 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:32:59.965234 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-9f3ae0ce-6be4-4f88-9236-33793d60649b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:32:59.967403 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-9f3ae0ce-6be4-4f88-9236-33793d60649b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:32:59.972239 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9f3ae0ce-6be4-4f88-9236-33793d60649b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:59.972688 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9f3ae0ce-6be4-4f88-9236-33793d60649b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:32:59.973535 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9f3ae0ce-6be4-4f88-9236-33793d60649b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:32:59.973980 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9f3ae0ce-6be4-4f88-9236-33793d60649b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:00.065094 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-2930c6c4-fe06-471e-9cff-a95f9119e637 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:00.065848 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-2930c6c4-fe06-471e-9cff-a95f9119e637 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:00.072804 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2930c6c4-fe06-471e-9cff-a95f9119e637 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:00.078535 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2930c6c4-fe06-471e-9cff-a95f9119e637 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:00.078535 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2930c6c4-fe06-471e-9cff-a95f9119e637 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:00.078535 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2930c6c4-fe06-471e-9cff-a95f9119e637 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:00.105001 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-2930c6c4-fe06-471e-9cff-a95f9119e637 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94/ips" status: 200 len: 149 microversion: 2.1 time: 0.040536 Jun 14 18:33:00.105001 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 352/737] 10.222.0.78 () {58 vars in 1247 bytes} [Tue Jun 14 18:33:00 2022] GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:33:00.120895 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-9f3ae0ce-6be4-4f88-9236-33793d60649b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:00.128039 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-36793e87-bb4a-4f03-a1dd-7cdf5d80d82a tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:00.133967 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-36793e87-bb4a-4f03-a1dd-7cdf5d80d82a tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:00.134126 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-9f3ae0ce-6be4-4f88-9236-33793d60649b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:00.135328 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-9f3ae0ce-6be4-4f88-9236-33793d60649b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:00.135944 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-36793e87-bb4a-4f03-a1dd-7cdf5d80d82a tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:00.136535 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-9f3ae0ce-6be4-4f88-9236-33793d60649b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1725 microversion: 2.20 time: 0.175294 Jun 14 18:33:00.136766 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-36793e87-bb4a-4f03-a1dd-7cdf5d80d82a tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:00.147116 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 386/738] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:32:59 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:33:00.147711 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-36793e87-bb4a-4f03-a1dd-7cdf5d80d82a tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:00.147711 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-36793e87-bb4a-4f03-a1dd-7cdf5d80d82a tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:00.306173 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-36793e87-bb4a-4f03-a1dd-7cdf5d80d82a tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:00.315610 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-36793e87-bb4a-4f03-a1dd-7cdf5d80d82a tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1569 microversion: 2.1 time: 0.191418 Jun 14 18:33:00.317404 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 353/739] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:00 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1569 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:33:01.154465 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-4f75bacd-aab9-4b90-8ce2-1c4a0ff7ecf4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:01.155066 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-4f75bacd-aab9-4b90-8ce2-1c4a0ff7ecf4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:01.161756 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4f75bacd-aab9-4b90-8ce2-1c4a0ff7ecf4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:01.162235 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4f75bacd-aab9-4b90-8ce2-1c4a0ff7ecf4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:01.163013 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4f75bacd-aab9-4b90-8ce2-1c4a0ff7ecf4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:01.163451 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4f75bacd-aab9-4b90-8ce2-1c4a0ff7ecf4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:01.294484 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-4f75bacd-aab9-4b90-8ce2-1c4a0ff7ecf4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:01.303247 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-4f75bacd-aab9-4b90-8ce2-1c4a0ff7ecf4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:01.304765 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-4f75bacd-aab9-4b90-8ce2-1c4a0ff7ecf4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:01.305985 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-4f75bacd-aab9-4b90-8ce2-1c4a0ff7ecf4 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1725 microversion: 2.20 time: 0.155606 Jun 14 18:33:01.311139 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 387/740] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:33:01 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:33:01.334366 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-dcf8ca3c-854e-46fd-94d9-e83938f47278 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:01.334979 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-dcf8ca3c-854e-46fd-94d9-e83938f47278 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:01.341746 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-dcf8ca3c-854e-46fd-94d9-e83938f47278 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:01.345543 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-dcf8ca3c-854e-46fd-94d9-e83938f47278 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:01.345543 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-dcf8ca3c-854e-46fd-94d9-e83938f47278 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:01.345543 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-dcf8ca3c-854e-46fd-94d9-e83938f47278 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:01.477382 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-dcf8ca3c-854e-46fd-94d9-e83938f47278 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:01.486891 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-dcf8ca3c-854e-46fd-94d9-e83938f47278 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1569 microversion: 2.1 time: 0.156397 Jun 14 18:33:01.487621 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 354/741] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:01 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:01.806150 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-bd438413-c784-4ce7-abf7-d04b81fc4c18 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ce8d293-5f4a-4290-9a1d-6fd833bd08e0"}} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:33:01.807273 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-bd438413-c784-4ce7-abf7-d04b81fc4c18 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:01.813720 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-bd438413-c784-4ce7-abf7-d04b81fc4c18 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:01.814165 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-bd438413-c784-4ce7-abf7-d04b81fc4c18 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:01.814931 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-bd438413-c784-4ce7-abf7-d04b81fc4c18 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:01.815364 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-bd438413-c784-4ce7-abf7-d04b81fc4c18 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:02.324291 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-ba140eca-b9b6-40a4-b328-c20db5e10689 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:02.324913 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-ba140eca-b9b6-40a4-b328-c20db5e10689 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:02.331401 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ba140eca-b9b6-40a4-b328-c20db5e10689 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:02.331862 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ba140eca-b9b6-40a4-b328-c20db5e10689 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:02.332619 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ba140eca-b9b6-40a4-b328-c20db5e10689 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:02.333051 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ba140eca-b9b6-40a4-b328-c20db5e10689 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:02.483781 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-ba140eca-b9b6-40a4-b328-c20db5e10689 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:02.492339 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-ba140eca-b9b6-40a4-b328-c20db5e10689 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:02.493859 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-ba140eca-b9b6-40a4-b328-c20db5e10689 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:02.495004 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-ba140eca-b9b6-40a4-b328-c20db5e10689 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1725 microversion: 2.20 time: 0.174818 Jun 14 18:33:02.495614 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 355/742] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:33:02 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:33:02.504234 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-9d4519c7-590d-40a1-98bf-0c2960a82650 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:02.504933 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-9d4519c7-590d-40a1-98bf-0c2960a82650 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:02.512183 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9d4519c7-590d-40a1-98bf-0c2960a82650 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:02.513178 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9d4519c7-590d-40a1-98bf-0c2960a82650 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:02.514038 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9d4519c7-590d-40a1-98bf-0c2960a82650 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:02.515249 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9d4519c7-590d-40a1-98bf-0c2960a82650 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:02.663836 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-9d4519c7-590d-40a1-98bf-0c2960a82650 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:02.675899 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-9d4519c7-590d-40a1-98bf-0c2960a82650 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1569 microversion: 2.1 time: 0.175601 Jun 14 18:33:02.676482 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 356/743] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:02 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:33:02.757911 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-bd438413-c784-4ce7-abf7-d04b81fc4c18 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "POST /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.955475 Jun 14 18:33:02.758747 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 388/744] 10.222.0.78 () {60 vars in 1322 bytes} [Tue Jun 14 18:33:01 2022] POST /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94/os-volume_attachments => generated 194 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:33:03.514506 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-d325e924-f6ee-4b3d-aa55-b49723d53a39 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:03.515107 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-d325e924-f6ee-4b3d-aa55-b49723d53a39 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:03.522580 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d325e924-f6ee-4b3d-aa55-b49723d53a39 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:03.523039 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d325e924-f6ee-4b3d-aa55-b49723d53a39 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:03.523819 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d325e924-f6ee-4b3d-aa55-b49723d53a39 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:03.524261 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d325e924-f6ee-4b3d-aa55-b49723d53a39 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:03.694283 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-d325e924-f6ee-4b3d-aa55-b49723d53a39 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:03.695831 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-9d7fef8d-1471-417d-a1fc-674cac3732c3 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:03.698029 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-9d7fef8d-1471-417d-a1fc-674cac3732c3 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:03.703524 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-d325e924-f6ee-4b3d-aa55-b49723d53a39 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:03.705307 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-d325e924-f6ee-4b3d-aa55-b49723d53a39 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:03.706542 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-d325e924-f6ee-4b3d-aa55-b49723d53a39 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1725 microversion: 2.20 time: 0.196953 Jun 14 18:33:03.707121 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 357/745] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:33:03 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:33:03.714282 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9d7fef8d-1471-417d-a1fc-674cac3732c3 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:03.714742 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9d7fef8d-1471-417d-a1fc-674cac3732c3 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:03.715539 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9d7fef8d-1471-417d-a1fc-674cac3732c3 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:03.716029 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9d7fef8d-1471-417d-a1fc-674cac3732c3 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:03.870572 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-9d7fef8d-1471-417d-a1fc-674cac3732c3 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:03.878756 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-9d7fef8d-1471-417d-a1fc-674cac3732c3 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1569 microversion: 2.1 time: 0.187886 Jun 14 18:33:03.879321 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 389/746] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:03 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:33:04.727332 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-035b6b30-8027-4a4b-8da6-dad8d3f7de8c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:04.738429 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-035b6b30-8027-4a4b-8da6-dad8d3f7de8c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:04.738429 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-035b6b30-8027-4a4b-8da6-dad8d3f7de8c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:04.738429 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-035b6b30-8027-4a4b-8da6-dad8d3f7de8c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:04.738429 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-035b6b30-8027-4a4b-8da6-dad8d3f7de8c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:04.738896 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-035b6b30-8027-4a4b-8da6-dad8d3f7de8c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:04.896279 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-8357512d-1869-4423-999b-9a6423cb49ea tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:04.897143 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-8357512d-1869-4423-999b-9a6423cb49ea tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:04.906434 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8357512d-1869-4423-999b-9a6423cb49ea tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:04.915773 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8357512d-1869-4423-999b-9a6423cb49ea tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:04.915773 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8357512d-1869-4423-999b-9a6423cb49ea tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:04.915773 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8357512d-1869-4423-999b-9a6423cb49ea tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:04.917080 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-035b6b30-8027-4a4b-8da6-dad8d3f7de8c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:04.934997 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-035b6b30-8027-4a4b-8da6-dad8d3f7de8c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:04.936679 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-035b6b30-8027-4a4b-8da6-dad8d3f7de8c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:04.937918 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-035b6b30-8027-4a4b-8da6-dad8d3f7de8c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1725 microversion: 2.20 time: 0.215751 Jun 14 18:33:04.938473 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 358/747] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:33:04 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1725 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:33:05.092963 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-8357512d-1869-4423-999b-9a6423cb49ea tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:05.103760 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-8357512d-1869-4423-999b-9a6423cb49ea tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1569 microversion: 2.1 time: 0.211370 Jun 14 18:33:05.104549 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 390/748] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:04 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1569 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:33:05.956770 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-e8138147-dfe7-4a64-a395-fcaea70ffc00 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:05.957424 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-e8138147-dfe7-4a64-a395-fcaea70ffc00 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:05.966479 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e8138147-dfe7-4a64-a395-fcaea70ffc00 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:05.966854 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e8138147-dfe7-4a64-a395-fcaea70ffc00 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:05.967963 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e8138147-dfe7-4a64-a395-fcaea70ffc00 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:05.968434 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e8138147-dfe7-4a64-a395-fcaea70ffc00 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:06.115353 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-e8138147-dfe7-4a64-a395-fcaea70ffc00 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:06.125482 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-e8138147-dfe7-4a64-a395-fcaea70ffc00 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:06.125810 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-fff41164-1d15-4bfb-8b68-ad9fc212afb2 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:06.126514 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-fff41164-1d15-4bfb-8b68-ad9fc212afb2 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:06.126982 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-e8138147-dfe7-4a64-a395-fcaea70ffc00 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:06.128350 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-e8138147-dfe7-4a64-a395-fcaea70ffc00 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1725 microversion: 2.20 time: 0.175855 Jun 14 18:33:06.129247 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 359/749] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:33:05 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:33:06.133527 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-fff41164-1d15-4bfb-8b68-ad9fc212afb2 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:06.134222 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-fff41164-1d15-4bfb-8b68-ad9fc212afb2 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:06.135135 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-fff41164-1d15-4bfb-8b68-ad9fc212afb2 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:06.135569 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-fff41164-1d15-4bfb-8b68-ad9fc212afb2 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:06.139853 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:33:06.284753 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-fff41164-1d15-4bfb-8b68-ad9fc212afb2 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:06.294833 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-fff41164-1d15-4bfb-8b68-ad9fc212afb2 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1569 microversion: 2.1 time: 0.173789 Jun 14 18:33:06.295548 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 391/750] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:06 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:33:06.743824 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-6567eaa0-03a1-4959-8438-6beeced0d0e5 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:06.744819 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-6567eaa0-03a1-4959-8438-6beeced0d0e5 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 41923641-5855-4385-8905-cc7dc5a46714] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:06.751533 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6567eaa0-03a1-4959-8438-6beeced0d0e5 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:06.751983 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6567eaa0-03a1-4959-8438-6beeced0d0e5 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:06.752753 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6567eaa0-03a1-4959-8438-6beeced0d0e5 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:06.753756 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6567eaa0-03a1-4959-8438-6beeced0d0e5 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:06.784725 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-6567eaa0-03a1-4959-8438-6beeced0d0e5 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044740 Jun 14 18:33:06.785294 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 360/751] 10.222.0.78 () {58 vars in 1301 bytes} [Tue Jun 14 18:33:06 2022] GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:33:06.796581 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-e0058a0d-e613-4c84-8939-25ce44e953e2 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:06.796994 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-e0058a0d-e613-4c84-8939-25ce44e953e2 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 41923641-5855-4385-8905-cc7dc5a46714] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:06.803674 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e0058a0d-e613-4c84-8939-25ce44e953e2 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:06.804135 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e0058a0d-e613-4c84-8939-25ce44e953e2 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:06.804924 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e0058a0d-e613-4c84-8939-25ce44e953e2 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:06.805363 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e0058a0d-e613-4c84-8939-25ce44e953e2 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:06.844611 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-e0058a0d-e613-4c84-8939-25ce44e953e2 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714/os-volume_attachments/f8cbd24e-84de-4ad0-b181-46571c18b6d7" status: 200 len: 194 microversion: 2.1 time: 0.052629 Jun 14 18:33:06.845551 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 392/752] 10.222.0.78 () {58 vars in 1412 bytes} [Tue Jun 14 18:33:06 2022] GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714/os-volume_attachments/f8cbd24e-84de-4ad0-b181-46571c18b6d7 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:33:07.154298 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-ea7aca48-feef-4997-8546-875f6130568a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:07.156720 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-ea7aca48-feef-4997-8546-875f6130568a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:07.172062 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ea7aca48-feef-4997-8546-875f6130568a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:07.172062 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ea7aca48-feef-4997-8546-875f6130568a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:07.172062 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ea7aca48-feef-4997-8546-875f6130568a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:07.172062 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ea7aca48-feef-4997-8546-875f6130568a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:07.312573 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-0e47ffb1-6f49-4bdf-a181-f24f211777f2 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:07.313746 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-0e47ffb1-6f49-4bdf-a181-f24f211777f2 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:07.321191 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-0e47ffb1-6f49-4bdf-a181-f24f211777f2 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:07.322106 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-0e47ffb1-6f49-4bdf-a181-f24f211777f2 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:07.322896 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-0e47ffb1-6f49-4bdf-a181-f24f211777f2 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:07.323330 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-0e47ffb1-6f49-4bdf-a181-f24f211777f2 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:07.345789 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-ea7aca48-feef-4997-8546-875f6130568a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:07.355027 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-ea7aca48-feef-4997-8546-875f6130568a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:07.357472 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-ea7aca48-feef-4997-8546-875f6130568a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:07.358779 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-ea7aca48-feef-4997-8546-875f6130568a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1746 microversion: 2.20 time: 0.212540 Jun 14 18:33:07.359400 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 361/753] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:33:07 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1746 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:33:07.477650 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-0e47ffb1-6f49-4bdf-a181-f24f211777f2 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:07.486864 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-0e47ffb1-6f49-4bdf-a181-f24f211777f2 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1569 microversion: 2.1 time: 0.178293 Jun 14 18:33:07.495860 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 393/754] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:07 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:08.386861 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-c55dd837-9105-4996-86a4-866f4f248a10 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:08.387461 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-c55dd837-9105-4996-86a4-866f4f248a10 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:08.394849 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c55dd837-9105-4996-86a4-866f4f248a10 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:08.395390 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c55dd837-9105-4996-86a4-866f4f248a10 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:08.396227 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c55dd837-9105-4996-86a4-866f4f248a10 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:08.396835 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c55dd837-9105-4996-86a4-866f4f248a10 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:08.513916 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-f4bdeadf-7a9e-4d35-977a-df7228d6c458 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:08.514547 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-f4bdeadf-7a9e-4d35-977a-df7228d6c458 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:08.526735 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f4bdeadf-7a9e-4d35-977a-df7228d6c458 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:08.527203 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f4bdeadf-7a9e-4d35-977a-df7228d6c458 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:08.533708 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f4bdeadf-7a9e-4d35-977a-df7228d6c458 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:08.535826 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f4bdeadf-7a9e-4d35-977a-df7228d6c458 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:08.599484 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-c55dd837-9105-4996-86a4-866f4f248a10 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:08.615624 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-c55dd837-9105-4996-86a4-866f4f248a10 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:08.625677 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-c55dd837-9105-4996-86a4-866f4f248a10 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:08.627898 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-c55dd837-9105-4996-86a4-866f4f248a10 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1741 microversion: 2.20 time: 0.244910 Jun 14 18:33:08.636891 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 362/755] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:33:08 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1741 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:33:08.642471 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-29db871f-f766-455f-b3c7-b6c70a0e5942 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d5db2c6-b356-40b1-bff2-779df3c1ffde"}} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:33:08.643252 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-29db871f-f766-455f-b3c7-b6c70a0e5942 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 41923641-5855-4385-8905-cc7dc5a46714] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:08.649720 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-29db871f-f766-455f-b3c7-b6c70a0e5942 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:08.650164 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-29db871f-f766-455f-b3c7-b6c70a0e5942 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:08.650928 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-29db871f-f766-455f-b3c7-b6c70a0e5942 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:08.651356 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-29db871f-f766-455f-b3c7-b6c70a0e5942 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:08.725354 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-f4bdeadf-7a9e-4d35-977a-df7228d6c458 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:08.738256 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-f4bdeadf-7a9e-4d35-977a-df7228d6c458 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1569 microversion: 2.1 time: 0.228688 Jun 14 18:33:08.738857 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 394/756] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:08 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1569 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:08.884168 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:33:09.647148 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-1416ae01-bbcf-4297-a2c7-b464aa700880 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:09.648353 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-1416ae01-bbcf-4297-a2c7-b464aa700880 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:09.656968 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1416ae01-bbcf-4297-a2c7-b464aa700880 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:09.657691 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1416ae01-bbcf-4297-a2c7-b464aa700880 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:09.658679 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1416ae01-bbcf-4297-a2c7-b464aa700880 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:09.659105 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1416ae01-bbcf-4297-a2c7-b464aa700880 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:09.696154 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-29db871f-f766-455f-b3c7-b6c70a0e5942 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "POST /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.065646 Jun 14 18:33:09.697699 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 363/757] 10.222.0.78 () {60 vars in 1322 bytes} [Tue Jun 14 18:33:08 2022] POST /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714/os-volume_attachments => generated 194 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:33:09.756606 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-326ed998-e189-425b-afb4-64ce9cdad282 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:09.757404 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-326ed998-e189-425b-afb4-64ce9cdad282 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:09.787328 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-326ed998-e189-425b-afb4-64ce9cdad282 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:09.787896 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-326ed998-e189-425b-afb4-64ce9cdad282 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:09.792565 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-326ed998-e189-425b-afb4-64ce9cdad282 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:09.793060 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-326ed998-e189-425b-afb4-64ce9cdad282 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:09.884485 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-1416ae01-bbcf-4297-a2c7-b464aa700880 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:09.895260 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-1416ae01-bbcf-4297-a2c7-b464aa700880 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:09.898021 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-1416ae01-bbcf-4297-a2c7-b464aa700880 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:09.899444 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-1416ae01-bbcf-4297-a2c7-b464aa700880 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1741 microversion: 2.20 time: 0.256184 Jun 14 18:33:09.900345 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 395/758] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:33:09 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1741 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:33:10.028076 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-326ed998-e189-425b-afb4-64ce9cdad282 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:10.042188 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-326ed998-e189-425b-afb4-64ce9cdad282 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1569 microversion: 2.1 time: 0.286856 Jun 14 18:33:10.043067 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 364/759] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:09 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1569 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:33:10.923078 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-9579a3d1-ea7c-4a68-807f-346bee659c30 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:10.924853 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-9579a3d1-ea7c-4a68-807f-346bee659c30 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:10.933088 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9579a3d1-ea7c-4a68-807f-346bee659c30 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:10.933886 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9579a3d1-ea7c-4a68-807f-346bee659c30 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:10.936217 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9579a3d1-ea7c-4a68-807f-346bee659c30 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:10.936950 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9579a3d1-ea7c-4a68-807f-346bee659c30 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:11.062016 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-7f26b735-7b26-4ce3-bd63-61547cb48e77 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:11.062636 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-7f26b735-7b26-4ce3-bd63-61547cb48e77 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:11.069945 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7f26b735-7b26-4ce3-bd63-61547cb48e77 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:11.071499 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7f26b735-7b26-4ce3-bd63-61547cb48e77 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:11.072392 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7f26b735-7b26-4ce3-bd63-61547cb48e77 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:11.072894 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7f26b735-7b26-4ce3-bd63-61547cb48e77 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:11.166025 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-9579a3d1-ea7c-4a68-807f-346bee659c30 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:11.181319 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-9579a3d1-ea7c-4a68-807f-346bee659c30 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:11.181566 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-9579a3d1-ea7c-4a68-807f-346bee659c30 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:11.182977 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-9579a3d1-ea7c-4a68-807f-346bee659c30 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1741 microversion: 2.20 time: 0.265845 Jun 14 18:33:11.184044 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 396/760] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:33:10 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1741 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:33:11.249410 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-7f26b735-7b26-4ce3-bd63-61547cb48e77 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:11.265287 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-7f26b735-7b26-4ce3-bd63-61547cb48e77 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1569 microversion: 2.1 time: 0.208140 Jun 14 18:33:11.267595 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 365/761] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:11 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1569 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:33:11.699677 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-b0bdccc5-b064-4081-9bb7-50120b161d67 req-6bbf2a70-eb5f-492b-a5ba-af90e8da282c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86678293-5e78-4bb0-9bc8-0a02da6d1a0b", "name": "network-vif-plugged", "status": "completed", "tag": "9a48c21f-378c-4db8-a26f-6ed7263009cb"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:33:11.709322 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-b0bdccc5-b064-4081-9bb7-50120b161d67 req-6bbf2a70-eb5f-492b-a5ba-af90e8da282c service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:11.709980 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-b0bdccc5-b064-4081-9bb7-50120b161d67 req-6bbf2a70-eb5f-492b-a5ba-af90e8da282c service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:11.722473 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-b0bdccc5-b064-4081-9bb7-50120b161d67 req-6bbf2a70-eb5f-492b-a5ba-af90e8da282c service nova] Creating event network-vif-plugged:9a48c21f-378c-4db8-a26f-6ed7263009cb for instance 86678293-5e78-4bb0-9bc8-0a02da6d1a0b on hv-cinder-84456 Jun 14 18:33:11.728416 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-b0bdccc5-b064-4081-9bb7-50120b161d67 req-6bbf2a70-eb5f-492b-a5ba-af90e8da282c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.239481 Jun 14 18:33:11.729160 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 397/762] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:33:12.202857 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-2fcbb61e-122c-48a8-88d8-c2c24dc57958 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:12.204346 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-2fcbb61e-122c-48a8-88d8-c2c24dc57958 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:12.211714 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2fcbb61e-122c-48a8-88d8-c2c24dc57958 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:12.212080 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2fcbb61e-122c-48a8-88d8-c2c24dc57958 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:12.212866 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2fcbb61e-122c-48a8-88d8-c2c24dc57958 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:12.213306 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2fcbb61e-122c-48a8-88d8-c2c24dc57958 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:12.286854 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-9a3c4355-cca0-423c-ac60-bb9f51601f93 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:12.288310 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-9a3c4355-cca0-423c-ac60-bb9f51601f93 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:12.296870 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9a3c4355-cca0-423c-ac60-bb9f51601f93 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:12.297362 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9a3c4355-cca0-423c-ac60-bb9f51601f93 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:12.298484 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9a3c4355-cca0-423c-ac60-bb9f51601f93 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:12.299337 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9a3c4355-cca0-423c-ac60-bb9f51601f93 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:12.391736 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-2fcbb61e-122c-48a8-88d8-c2c24dc57958 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:12.400505 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-2fcbb61e-122c-48a8-88d8-c2c24dc57958 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:12.402142 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-2fcbb61e-122c-48a8-88d8-c2c24dc57958 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:12.403386 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-2fcbb61e-122c-48a8-88d8-c2c24dc57958 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1741 microversion: 2.20 time: 0.205665 Jun 14 18:33:12.403965 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 366/763] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:33:12 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1741 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:33:12.473229 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-9a3c4355-cca0-423c-ac60-bb9f51601f93 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:12.481637 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-9a3c4355-cca0-423c-ac60-bb9f51601f93 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1570 microversion: 2.1 time: 0.200249 Jun 14 18:33:12.482219 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 398/764] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:12 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1570 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:12.500401 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-61f6b2a7-d80c-4564-bbc1-fc0e5ccd4494 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:33:12.500705 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-61f6b2a7-d80c-4564-bbc1-fc0e5ccd4494 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:12.508195 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-61f6b2a7-d80c-4564-bbc1-fc0e5ccd4494 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:12.508839 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-61f6b2a7-d80c-4564-bbc1-fc0e5ccd4494 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:12.509971 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-61f6b2a7-d80c-4564-bbc1-fc0e5ccd4494 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:12.510614 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-61f6b2a7-d80c-4564-bbc1-fc0e5ccd4494 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:12.844662 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-61f6b2a7-d80c-4564-bbc1-fc0e5ccd4494 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "POST /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64/action" status: 202 len: 0 microversion: 2.1 time: 0.349785 Jun 14 18:33:12.850954 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 367/765] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Jun 14 18:33:12 2022] POST /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 14 18:33:12.857184 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-d15c853a-0f27-4f88-9e26-a4b1034fdb52 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:12.858692 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-d15c853a-0f27-4f88-9e26-a4b1034fdb52 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:12.874103 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d15c853a-0f27-4f88-9e26-a4b1034fdb52 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:12.874759 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d15c853a-0f27-4f88-9e26-a4b1034fdb52 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:12.875408 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d15c853a-0f27-4f88-9e26-a4b1034fdb52 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:12.875856 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d15c853a-0f27-4f88-9e26-a4b1034fdb52 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:13.139436 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-d15c853a-0f27-4f88-9e26-a4b1034fdb52 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:13.158613 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-d15c853a-0f27-4f88-9e26-a4b1034fdb52 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1578 microversion: 2.1 time: 0.306574 Jun 14 18:33:13.171972 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 399/766] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:12 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1578 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:13.434223 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-1e1ffddd-d27f-4b2f-9a8e-a0a0877f2627 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:13.434223 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-1e1ffddd-d27f-4b2f-9a8e-a0a0877f2627 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:13.440207 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1e1ffddd-d27f-4b2f-9a8e-a0a0877f2627 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:13.440655 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1e1ffddd-d27f-4b2f-9a8e-a0a0877f2627 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:13.442005 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1e1ffddd-d27f-4b2f-9a8e-a0a0877f2627 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:13.443338 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1e1ffddd-d27f-4b2f-9a8e-a0a0877f2627 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:13.667255 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-1e1ffddd-d27f-4b2f-9a8e-a0a0877f2627 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:13.683029 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-1e1ffddd-d27f-4b2f-9a8e-a0a0877f2627 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:13.689047 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-1e1ffddd-d27f-4b2f-9a8e-a0a0877f2627 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:13.692461 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-1e1ffddd-d27f-4b2f-9a8e-a0a0877f2627 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1741 microversion: 2.20 time: 0.267529 Jun 14 18:33:13.695362 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 368/767] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:33:13 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1741 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:33:13.782356 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-2840f270-233e-4e2c-ae0d-32f6e2af83fe tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ce8d293-5f4a-4290-9a1d-6fd833bd08e0"}} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:33:13.783724 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-2840f270-233e-4e2c-ae0d-32f6e2af83fe tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:13.797404 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2840f270-233e-4e2c-ae0d-32f6e2af83fe tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:13.797941 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2840f270-233e-4e2c-ae0d-32f6e2af83fe tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:13.798997 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2840f270-233e-4e2c-ae0d-32f6e2af83fe tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:13.800700 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2840f270-233e-4e2c-ae0d-32f6e2af83fe tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:13.940398 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.wsgi [None req-2840f270-233e-4e2c-ae0d-32f6e2af83fe tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] HTTP exception thrown: Invalid volume: volume 1ce8d293-5f4a-4290-9a1d-6fd833bd08e0 is already attached to instances: 678e536c-8e80-49f6-90d0-72aec54c7c94 Jun 14 18:33:13.956682 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-2840f270-233e-4e2c-ae0d-32f6e2af83fe tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Request method failure captured: Jun 14 18:33:13.956682 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: request: POST /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94/os-volume_attachments HTTP/1.1 Jun 14 18:33:13.956682 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept: application/json Jun 14 18:33:13.956682 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept-Encoding: identity Jun 14 18:33:13.956682 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Connection: close Jun 14 18:33:13.956682 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Length: 74 Jun 14 18:33:13.956682 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Type: application/json Jun 14 18:33:13.956682 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Host: 10.222.0.78 Jun 14 18:33:13.956682 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Openstack-System-Scope: None Jun 14 18:33:13.956682 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: User-Agent: python-urllib3/1.26.9 Jun 14 18:33:13.956682 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Auth-Token: gAAAAABiqNNRwUW-ILUkPK_wgILFSFKwt3erUOv38mYIB0oCeDDiotO112_xIQykQF206CMg3446rqZisR6hzfab3579MeUncL30z5LdS-2pD1weLSQ2dqyxdVYPdVwx-jGbuP7Kwf2vbYNW1CdwMR0V5q1_4RRQAdNuD7UVUw8E8v9L5saJIsU Jun 14 18:33:13.956682 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Id: None Jun 14 18:33:13.956682 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Name: None Jun 14 18:33:13.956682 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Identity-Status: Confirmed Jun 14 18:33:13.956682 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Is-Admin-Project: True Jun 14 18:33:13.956682 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Id: default Jun 14 18:33:13.956682 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Name: Default Jun 14 18:33:13.956682 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Id: 56f8367a52044e82a2c272da39e1bfd8 Jun 14 18:33:13.956682 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Name: tempest-AttachVolumeNegativeTest-1598181014 Jun 14 18:33:13.956682 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Role: reader,member Jun 14 18:33:13.956682 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Roles: reader,member Jun 14 18:33:13.963868 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_56f8367a52044e82a2c272da39e1bfd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/56f8367a52044e82a2c272da39e1bfd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/56f8367a52044e82a2c272da39e1bfd8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/56f8367a52044e82a2c272da39e1bfd8"}]}] Jun 14 18:33:13.963868 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant: tempest-AttachVolumeNegativeTest-1598181014 Jun 14 18:33:13.963868 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Id: 56f8367a52044e82a2c272da39e1bfd8 Jun 14 18:33:13.963868 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1598181014 Jun 14 18:33:13.963868 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User: tempest-AttachVolumeNegativeTest-1598181014-project Jun 14 18:33:13.963868 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Id: default Jun 14 18:33:13.963868 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Name: Default Jun 14 18:33:13.963868 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Id: 9254bd46822346009497b01d28314335 Jun 14 18:33:13.963868 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Name: tempest-AttachVolumeNegativeTest-1598181014-project Jun 14 18:33:13.963868 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Jun 14 18:33:13.963868 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: {"volumeAttachment": {"volumeId": "1ce8d293-5f4a-4290-9a1d-6fd833bd08e0"}} Jun 14 18:33:13.963868 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: method: > Jun 14 18:33:13.964796 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: exception: Invalid volume: volume 1ce8d293-5f4a-4290-9a1d-6fd833bd08e0 is already attached to instances: 678e536c-8e80-49f6-90d0-72aec54c7c94 Jun 14 18:33:13.964796 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: action_args: {'server_id': '678e536c-8e80-49f6-90d0-72aec54c7c94', 'body': {'volumeAttachment': {'volumeId': '1ce8d293-5f4a-4290-9a1d-6fd833bd08e0'}}} Jun 14 18:33:13.964796 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:33:13.964796 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:33:13.964796 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 14 18:33:13.964796 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 14 18:33:13.964796 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 14 18:33:13.964796 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 14 18:33:13.964796 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 14 18:33:13.964796 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 14 18:33:13.964796 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 14 18:33:13.964796 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 14 18:33:13.964796 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 14 18:33:13.964796 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 14 18:33:13.964796 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1ce8d293-5f4a-4290-9a1d-6fd833bd08e0 is already attached to instances: 678e536c-8e80-49f6-90d0-72aec54c7c94 Jun 14 18:33:13.964796 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:33:13.964796 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:33:13.964796 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:33:13.964796 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:33:13.966164 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:33:13.966164 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:33:13.966164 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:33:13.966164 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:33:13.966164 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:33:13.966164 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:33:13.966164 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 14 18:33:13.966164 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 14 18:33:13.966164 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 14 18:33:13.966164 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 14 18:33:13.966164 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 14 18:33:13.966164 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 14 18:33:13.966164 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 14 18:33:13.966164 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 14 18:33:13.966164 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1ce8d293-5f4a-4290-9a1d-6fd833bd08e0 is already attached to instances: 678e536c-8e80-49f6-90d0-72aec54c7c94 Jun 14 18:33:13.966164 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:33:13.966164 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:33:13.966164 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:33:13.966164 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:33:13.966164 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:33:13.967576 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:33:13.967576 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:33:13.967576 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:33:13.967576 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1ce8d293-5f4a-4290-9a1d-6fd833bd08e0 is already attached to instances: 678e536c-8e80-49f6-90d0-72aec54c7c94 Jun 14 18:33:13.967576 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:33:13.967576 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-2840f270-233e-4e2c-ae0d-32f6e2af83fe tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Returning 400 to user: Invalid volume: volume 1ce8d293-5f4a-4290-9a1d-6fd833bd08e0 is already attached to instances: 678e536c-8e80-49f6-90d0-72aec54c7c94 {{(pid=118624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:33:13.967576 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-2840f270-233e-4e2c-ae0d-32f6e2af83fe tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "POST /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.180956 Jun 14 18:33:13.967576 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 400/768] 10.222.0.78 () {60 vars in 1322 bytes} [Tue Jun 14 18:33:13 2022] POST /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94/os-volume_attachments => generated 174 bytes in 182 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 14 18:33:14.056740 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-9ee68f61-20b1-46ea-8034-36916f0ba684 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:14.057290 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-9ee68f61-20b1-46ea-8034-36916f0ba684 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:14.065889 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9ee68f61-20b1-46ea-8034-36916f0ba684 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:14.066335 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9ee68f61-20b1-46ea-8034-36916f0ba684 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:14.067153 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9ee68f61-20b1-46ea-8034-36916f0ba684 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:14.067765 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9ee68f61-20b1-46ea-8034-36916f0ba684 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:14.178941 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-a9af1657-6d76-4a48-bb31-6edc8fd1dafe tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:14.179562 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-a9af1657-6d76-4a48-bb31-6edc8fd1dafe tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:14.191082 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.objects.instance [None req-9ee68f61-20b1-46ea-8034-36916f0ba684 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lazy-loading 'services' on Instance uuid 678e536c-8e80-49f6-90d0-72aec54c7c94 {{(pid=118623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:33:14.200296 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a9af1657-6d76-4a48-bb31-6edc8fd1dafe tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:14.204601 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a9af1657-6d76-4a48-bb31-6edc8fd1dafe tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:14.205978 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a9af1657-6d76-4a48-bb31-6edc8fd1dafe tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:14.207083 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a9af1657-6d76-4a48-bb31-6edc8fd1dafe tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:14.460060 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-a9af1657-6d76-4a48-bb31-6edc8fd1dafe tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:14.470169 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-a9af1657-6d76-4a48-bb31-6edc8fd1dafe tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1518 microversion: 2.1 time: 0.295936 Jun 14 18:33:14.471318 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 401/769] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:14 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1518 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:14.547544 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-9ee68f61-20b1-46ea-8034-36916f0ba684 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "DELETE /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94/os-volume_attachments/1ce8d293-5f4a-4290-9a1d-6fd833bd08e0" status: 202 len: 0 microversion: 2.1 time: 0.493914 Jun 14 18:33:14.552076 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 369/770] 10.222.0.78 () {58 vars in 1415 bytes} [Tue Jun 14 18:33:14 2022] DELETE /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94/os-volume_attachments/1ce8d293-5f4a-4290-9a1d-6fd833bd08e0 => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:33:14.558590 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-280d7e6b-9c78-4fc4-9cea-7b20954e54a7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:14.561090 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-280d7e6b-9c78-4fc4-9cea-7b20954e54a7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:14.571702 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-280d7e6b-9c78-4fc4-9cea-7b20954e54a7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:14.572508 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-280d7e6b-9c78-4fc4-9cea-7b20954e54a7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:14.573574 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-280d7e6b-9c78-4fc4-9cea-7b20954e54a7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:14.574325 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-280d7e6b-9c78-4fc4-9cea-7b20954e54a7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:14.627307 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-280d7e6b-9c78-4fc4-9cea-7b20954e54a7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073785 Jun 14 18:33:14.628641 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 402/771] 10.222.0.78 () {58 vars in 1301 bytes} [Tue Jun 14 18:33:14 2022] GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:33:14.719023 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-12e9920e-354c-4766-9cdb-92d02ee082a2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:14.720040 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-12e9920e-354c-4766-9cdb-92d02ee082a2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:14.727173 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-12e9920e-354c-4766-9cdb-92d02ee082a2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:14.727838 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-12e9920e-354c-4766-9cdb-92d02ee082a2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:14.728947 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-12e9920e-354c-4766-9cdb-92d02ee082a2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:14.729534 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-12e9920e-354c-4766-9cdb-92d02ee082a2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:14.926900 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-12e9920e-354c-4766-9cdb-92d02ee082a2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:14.939481 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-12e9920e-354c-4766-9cdb-92d02ee082a2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:14.942805 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-12e9920e-354c-4766-9cdb-92d02ee082a2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:14.944041 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-12e9920e-354c-4766-9cdb-92d02ee082a2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1741 microversion: 2.20 time: 0.233436 Jun 14 18:33:14.945542 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 370/772] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:33:14 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1741 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:33:15.501983 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-87f33921-0f5f-469b-9bf8-7f877e2a4aa5 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:15.504175 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-87f33921-0f5f-469b-9bf8-7f877e2a4aa5 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:15.516519 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-81704279-39a8-46e7-bd3b-a9113d210217 req-c4e79af7-4a5c-41de-9d51-93597bc08e4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "750a5111-2788-46b6-aa18-57f7c1019d64", "name": "network-vif-unplugged", "status": "completed", "tag": "4fa1bac8-6b6d-4a62-afca-3aed68487621"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:33:15.545301 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-87f33921-0f5f-469b-9bf8-7f877e2a4aa5 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:15.546290 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-87f33921-0f5f-469b-9bf8-7f877e2a4aa5 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:15.547832 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-87f33921-0f5f-469b-9bf8-7f877e2a4aa5 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:15.548762 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-87f33921-0f5f-469b-9bf8-7f877e2a4aa5 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:15.552923 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-81704279-39a8-46e7-bd3b-a9113d210217 req-c4e79af7-4a5c-41de-9d51-93597bc08e4e service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:15.564312 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-81704279-39a8-46e7-bd3b-a9113d210217 req-c4e79af7-4a5c-41de-9d51-93597bc08e4e service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:15.591441 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.compute.server_external_events [req-81704279-39a8-46e7-bd3b-a9113d210217 req-c4e79af7-4a5c-41de-9d51-93597bc08e4e service nova] Unable to find a host for instance 750a5111-2788-46b6-aa18-57f7c1019d64. Dropping event network-vif-unplugged {{(pid=118623) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 14 18:33:15.592501 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-81704279-39a8-46e7-bd3b-a9113d210217 req-c4e79af7-4a5c-41de-9d51-93597bc08e4e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.084551 Jun 14 18:33:15.596948 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 371/773] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 90 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 14 18:33:15.643043 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-4abe1797-ae65-4862-93b9-c13903b7b3e7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:15.649292 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-4abe1797-ae65-4862-93b9-c13903b7b3e7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:15.680756 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4abe1797-ae65-4862-93b9-c13903b7b3e7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:15.685183 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4abe1797-ae65-4862-93b9-c13903b7b3e7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:15.688333 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4abe1797-ae65-4862-93b9-c13903b7b3e7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:15.690029 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4abe1797-ae65-4862-93b9-c13903b7b3e7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:15.771064 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-4abe1797-ae65-4862-93b9-c13903b7b3e7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132890 Jun 14 18:33:15.772952 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 372/774] 10.222.0.78 () {58 vars in 1301 bytes} [Tue Jun 14 18:33:15 2022] GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:33:15.811224 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-87f33921-0f5f-469b-9bf8-7f877e2a4aa5 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:15.822165 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-87f33921-0f5f-469b-9bf8-7f877e2a4aa5 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1520 microversion: 2.1 time: 0.329679 Jun 14 18:33:15.823358 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 403/775] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:15 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1520 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:15.966915 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-8d9e85d7-dd59-43b0-b9b2-239435ecda6b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:15.969422 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-8d9e85d7-dd59-43b0-b9b2-239435ecda6b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:15.976675 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8d9e85d7-dd59-43b0-b9b2-239435ecda6b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:15.978116 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8d9e85d7-dd59-43b0-b9b2-239435ecda6b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:15.979121 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8d9e85d7-dd59-43b0-b9b2-239435ecda6b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:15.979724 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8d9e85d7-dd59-43b0-b9b2-239435ecda6b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:16.167316 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-8d9e85d7-dd59-43b0-b9b2-239435ecda6b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:16.178813 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-8d9e85d7-dd59-43b0-b9b2-239435ecda6b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:16.180775 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-8d9e85d7-dd59-43b0-b9b2-239435ecda6b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:16.182853 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-8d9e85d7-dd59-43b0-b9b2-239435ecda6b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1741 microversion: 2.20 time: 0.223765 Jun 14 18:33:16.183721 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 373/776] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:33:15 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1741 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:33:16.784466 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-608d7e1c-277a-44a7-ab9e-eaef9995deef tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:16.786238 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-608d7e1c-277a-44a7-ab9e-eaef9995deef tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:16.793127 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-608d7e1c-277a-44a7-ab9e-eaef9995deef tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:16.793656 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-608d7e1c-277a-44a7-ab9e-eaef9995deef tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:16.794492 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-608d7e1c-277a-44a7-ab9e-eaef9995deef tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:16.797282 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-608d7e1c-277a-44a7-ab9e-eaef9995deef tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:16.854824 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-76f9d4a8-8afe-4aa7-b44e-468b997b9a93 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:16.860655 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-76f9d4a8-8afe-4aa7-b44e-468b997b9a93 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:16.873048 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-608d7e1c-277a-44a7-ab9e-eaef9995deef tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092351 Jun 14 18:33:16.875516 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-76f9d4a8-8afe-4aa7-b44e-468b997b9a93 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:16.875986 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-76f9d4a8-8afe-4aa7-b44e-468b997b9a93 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:16.877737 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-76f9d4a8-8afe-4aa7-b44e-468b997b9a93 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:16.878245 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-76f9d4a8-8afe-4aa7-b44e-468b997b9a93 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:16.884290 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 404/777] 10.222.0.78 () {58 vars in 1301 bytes} [Tue Jun 14 18:33:16 2022] GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:33:17.105280 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-76f9d4a8-8afe-4aa7-b44e-468b997b9a93 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:17.121219 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-76f9d4a8-8afe-4aa7-b44e-468b997b9a93 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1520 microversion: 2.1 time: 0.270108 Jun 14 18:33:17.131991 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 374/778] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:16 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1520 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:33:17.202882 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-c36704bc-44e5-4ec6-b27d-5ef3b0f239f8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:17.204410 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-c36704bc-44e5-4ec6-b27d-5ef3b0f239f8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:17.210200 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c36704bc-44e5-4ec6-b27d-5ef3b0f239f8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:17.210763 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c36704bc-44e5-4ec6-b27d-5ef3b0f239f8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:17.211734 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c36704bc-44e5-4ec6-b27d-5ef3b0f239f8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:17.212383 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c36704bc-44e5-4ec6-b27d-5ef3b0f239f8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:17.455577 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-c36704bc-44e5-4ec6-b27d-5ef3b0f239f8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:17.471235 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-c36704bc-44e5-4ec6-b27d-5ef3b0f239f8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:17.473503 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-c36704bc-44e5-4ec6-b27d-5ef3b0f239f8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:17.475696 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-c36704bc-44e5-4ec6-b27d-5ef3b0f239f8 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1741 microversion: 2.20 time: 0.277700 Jun 14 18:33:17.476909 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 405/779] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:33:17 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1741 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:33:17.893346 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-4351fe38-d29c-431d-8ab2-78580944a0c7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:17.894346 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-4351fe38-d29c-431d-8ab2-78580944a0c7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:17.901408 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4351fe38-d29c-431d-8ab2-78580944a0c7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:17.901883 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4351fe38-d29c-431d-8ab2-78580944a0c7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:17.903780 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4351fe38-d29c-431d-8ab2-78580944a0c7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:17.904085 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4351fe38-d29c-431d-8ab2-78580944a0c7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:17.960649 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-4351fe38-d29c-431d-8ab2-78580944a0c7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071156 Jun 14 18:33:17.964946 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 375/780] 10.222.0.78 () {58 vars in 1301 bytes} [Tue Jun 14 18:33:17 2022] GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:33:18.141071 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-7ac0c27f-2d1f-4eaf-bdc8-4362bab4316a tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:18.142418 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-7ac0c27f-2d1f-4eaf-bdc8-4362bab4316a tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:18.152125 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7ac0c27f-2d1f-4eaf-bdc8-4362bab4316a tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:18.152923 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7ac0c27f-2d1f-4eaf-bdc8-4362bab4316a tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:18.153970 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7ac0c27f-2d1f-4eaf-bdc8-4362bab4316a tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:18.154769 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7ac0c27f-2d1f-4eaf-bdc8-4362bab4316a tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:18.330122 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-7ac0c27f-2d1f-4eaf-bdc8-4362bab4316a tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:18.359023 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-7ac0c27f-2d1f-4eaf-bdc8-4362bab4316a tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1520 microversion: 2.1 time: 0.222330 Jun 14 18:33:18.360063 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 406/781] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:18 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1520 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:18.515969 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-6bb8c972-56d6-4992-949a-db6ef5f7d21a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:18.516975 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-6bb8c972-56d6-4992-949a-db6ef5f7d21a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:18.529708 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6bb8c972-56d6-4992-949a-db6ef5f7d21a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:18.535291 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6bb8c972-56d6-4992-949a-db6ef5f7d21a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:18.537667 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6bb8c972-56d6-4992-949a-db6ef5f7d21a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:18.538424 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6bb8c972-56d6-4992-949a-db6ef5f7d21a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:18.749584 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-6bb8c972-56d6-4992-949a-db6ef5f7d21a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:18.771068 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-6bb8c972-56d6-4992-949a-db6ef5f7d21a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:18.774116 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-6bb8c972-56d6-4992-949a-db6ef5f7d21a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:18.776177 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-6bb8c972-56d6-4992-949a-db6ef5f7d21a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1741 microversion: 2.20 time: 0.272783 Jun 14 18:33:18.777360 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 376/782] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:33:18 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1741 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:33:18.973369 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-f877abc2-a49d-435c-83c2-1ae9fb729f24 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:18.974322 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-f877abc2-a49d-435c-83c2-1ae9fb729f24 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:18.983456 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f877abc2-a49d-435c-83c2-1ae9fb729f24 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:18.984149 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f877abc2-a49d-435c-83c2-1ae9fb729f24 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:18.985060 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f877abc2-a49d-435c-83c2-1ae9fb729f24 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:18.985787 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f877abc2-a49d-435c-83c2-1ae9fb729f24 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:19.027618 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-f877abc2-a49d-435c-83c2-1ae9fb729f24 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058484 Jun 14 18:33:19.032359 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 407/783] 10.222.0.78 () {58 vars in 1301 bytes} [Tue Jun 14 18:33:18 2022] GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:33:19.384342 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-de2643b2-49a7-4c98-b497-e1b1a6f68d16 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:19.385192 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-de2643b2-49a7-4c98-b497-e1b1a6f68d16 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:19.398438 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-de2643b2-49a7-4c98-b497-e1b1a6f68d16 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:19.399648 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-de2643b2-49a7-4c98-b497-e1b1a6f68d16 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:19.401362 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-de2643b2-49a7-4c98-b497-e1b1a6f68d16 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:19.402150 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-de2643b2-49a7-4c98-b497-e1b1a6f68d16 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:19.658776 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-de2643b2-49a7-4c98-b497-e1b1a6f68d16 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:19.673979 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-de2643b2-49a7-4c98-b497-e1b1a6f68d16 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1520 microversion: 2.1 time: 0.295608 Jun 14 18:33:19.683581 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 377/784] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:19 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1520 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:19.815751 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-1fb5a03b-2725-456d-b957-32cac72bb26a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:19.816530 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-1fb5a03b-2725-456d-b957-32cac72bb26a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:19.823611 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1fb5a03b-2725-456d-b957-32cac72bb26a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:19.824080 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1fb5a03b-2725-456d-b957-32cac72bb26a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:19.825487 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1fb5a03b-2725-456d-b957-32cac72bb26a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:19.825952 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1fb5a03b-2725-456d-b957-32cac72bb26a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:19.858746 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell1:SELECT=100 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:33:20.045593 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-4d808dfc-f8bb-486c-809c-95d806c3bf0c tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:20.047553 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-4d808dfc-f8bb-486c-809c-95d806c3bf0c tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:20.060198 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4d808dfc-f8bb-486c-809c-95d806c3bf0c tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:20.061060 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4d808dfc-f8bb-486c-809c-95d806c3bf0c tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:20.062540 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4d808dfc-f8bb-486c-809c-95d806c3bf0c tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:20.063273 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4d808dfc-f8bb-486c-809c-95d806c3bf0c tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:20.108482 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:33:20.129663 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-4d808dfc-f8bb-486c-809c-95d806c3bf0c tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091357 Jun 14 18:33:20.130827 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 378/785] 10.222.0.78 () {58 vars in 1301 bytes} [Tue Jun 14 18:33:20 2022] GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:33:20.293156 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-1fb5a03b-2725-456d-b957-32cac72bb26a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:20.322726 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-1fb5a03b-2725-456d-b957-32cac72bb26a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:20.333981 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-1fb5a03b-2725-456d-b957-32cac72bb26a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:20.337625 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-1fb5a03b-2725-456d-b957-32cac72bb26a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1741 microversion: 2.20 time: 0.525071 Jun 14 18:33:20.338654 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 408/786] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:33:19 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1741 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:33:20.698994 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-001afc8c-cb10-470b-bb01-5dc43918454d tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:20.701066 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-001afc8c-cb10-470b-bb01-5dc43918454d tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:20.722599 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-001afc8c-cb10-470b-bb01-5dc43918454d tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:20.723394 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-001afc8c-cb10-470b-bb01-5dc43918454d tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:20.725102 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-001afc8c-cb10-470b-bb01-5dc43918454d tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:20.725957 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-001afc8c-cb10-470b-bb01-5dc43918454d tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:21.003039 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-001afc8c-cb10-470b-bb01-5dc43918454d tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:21.014513 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-001afc8c-cb10-470b-bb01-5dc43918454d tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1520 microversion: 2.1 time: 0.326078 Jun 14 18:33:21.015444 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 379/787] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:20 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1520 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:21.146060 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-09e81c5e-347b-41fa-8feb-0fbb30047c7a tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:21.147605 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-09e81c5e-347b-41fa-8feb-0fbb30047c7a tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:21.156788 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-09e81c5e-347b-41fa-8feb-0fbb30047c7a tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:21.157261 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-09e81c5e-347b-41fa-8feb-0fbb30047c7a tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:21.158204 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-09e81c5e-347b-41fa-8feb-0fbb30047c7a tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:21.158589 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-09e81c5e-347b-41fa-8feb-0fbb30047c7a tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:21.194171 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-09e81c5e-347b-41fa-8feb-0fbb30047c7a tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054651 Jun 14 18:33:21.194760 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 409/788] 10.222.0.78 () {58 vars in 1301 bytes} [Tue Jun 14 18:33:21 2022] GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:33:21.363289 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-e3f91c4b-7cfb-44cb-9f83-8a71481a11e3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:21.363901 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-e3f91c4b-7cfb-44cb-9f83-8a71481a11e3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:21.370371 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e3f91c4b-7cfb-44cb-9f83-8a71481a11e3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:21.370821 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e3f91c4b-7cfb-44cb-9f83-8a71481a11e3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:21.376293 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e3f91c4b-7cfb-44cb-9f83-8a71481a11e3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:21.376293 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e3f91c4b-7cfb-44cb-9f83-8a71481a11e3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:21.534239 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-e3f91c4b-7cfb-44cb-9f83-8a71481a11e3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:21.542860 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-e3f91c4b-7cfb-44cb-9f83-8a71481a11e3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:21.544403 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-e3f91c4b-7cfb-44cb-9f83-8a71481a11e3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:21.545617 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-e3f91c4b-7cfb-44cb-9f83-8a71481a11e3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1741 microversion: 2.20 time: 0.186367 Jun 14 18:33:21.546174 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 380/789] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:33:21 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1741 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:33:21.919166 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-aef07556-ba45-4556-9aa3-c63c453dbbf9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:21.920143 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-aef07556-ba45-4556-9aa3-c63c453dbbf9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 41923641-5855-4385-8905-cc7dc5a46714] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:21.926428 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-aef07556-ba45-4556-9aa3-c63c453dbbf9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:21.926879 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-aef07556-ba45-4556-9aa3-c63c453dbbf9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:21.927660 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-aef07556-ba45-4556-9aa3-c63c453dbbf9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:21.928159 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-aef07556-ba45-4556-9aa3-c63c453dbbf9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:21.969310 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-aef07556-ba45-4556-9aa3-c63c453dbbf9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.054951 Jun 14 18:33:21.970241 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 410/790] 10.222.0.78 () {58 vars in 1301 bytes} [Tue Jun 14 18:33:21 2022] GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714/os-volume_attachments => generated 371 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:33:22.038193 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-9eb22455-536b-4f82-a5a0-29eb9d3227a9 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:22.039285 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-9eb22455-536b-4f82-a5a0-29eb9d3227a9 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:22.053434 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9eb22455-536b-4f82-a5a0-29eb9d3227a9 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:22.054257 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9eb22455-536b-4f82-a5a0-29eb9d3227a9 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:22.055973 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9eb22455-536b-4f82-a5a0-29eb9d3227a9 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:22.056765 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9eb22455-536b-4f82-a5a0-29eb9d3227a9 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:22.134777 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-0ce837e9-986b-443a-be9c-9cbbbd7861c9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:22.135812 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-0ce837e9-986b-443a-be9c-9cbbbd7861c9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 41923641-5855-4385-8905-cc7dc5a46714] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:22.145029 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-0ce837e9-986b-443a-be9c-9cbbbd7861c9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:22.146207 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-0ce837e9-986b-443a-be9c-9cbbbd7861c9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:22.147851 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-0ce837e9-986b-443a-be9c-9cbbbd7861c9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:22.152173 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-0ce837e9-986b-443a-be9c-9cbbbd7861c9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:22.186787 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-0ce837e9-986b-443a-be9c-9cbbbd7861c9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714/os-volume_attachments/f8cbd24e-84de-4ad0-b181-46571c18b6d7" status: 200 len: 194 microversion: 2.1 time: 0.059428 Jun 14 18:33:22.187576 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 411/791] 10.222.0.78 () {58 vars in 1412 bytes} [Tue Jun 14 18:33:22 2022] GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714/os-volume_attachments/f8cbd24e-84de-4ad0-b181-46571c18b6d7 => generated 194 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:33:22.198339 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-403b6715-c002-449e-8af8-f93f7d35c280 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:22.198885 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-403b6715-c002-449e-8af8-f93f7d35c280 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 41923641-5855-4385-8905-cc7dc5a46714] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:22.206539 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-403b6715-c002-449e-8af8-f93f7d35c280 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:22.207182 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-403b6715-c002-449e-8af8-f93f7d35c280 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:22.207981 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-403b6715-c002-449e-8af8-f93f7d35c280 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:22.208699 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-403b6715-c002-449e-8af8-f93f7d35c280 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:22.274713 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-9eb22455-536b-4f82-a5a0-29eb9d3227a9 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:22.289554 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-9eb22455-536b-4f82-a5a0-29eb9d3227a9 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1520 microversion: 2.1 time: 0.258413 Jun 14 18:33:22.290889 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 381/792] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:22 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1520 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:22.300849 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-bff8aab9-0744-45d0-80bd-2b23fcdb2fd1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:22.302645 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-bff8aab9-0744-45d0-80bd-2b23fcdb2fd1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:22.306186 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_api:SELECT=71 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:33:22.315392 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-bff8aab9-0744-45d0-80bd-2b23fcdb2fd1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:22.315864 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-bff8aab9-0744-45d0-80bd-2b23fcdb2fd1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:22.317201 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-bff8aab9-0744-45d0-80bd-2b23fcdb2fd1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:22.318037 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-bff8aab9-0744-45d0-80bd-2b23fcdb2fd1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:22.334445 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.objects.instance [None req-403b6715-c002-449e-8af8-f93f7d35c280 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lazy-loading 'services' on Instance uuid 41923641-5855-4385-8905-cc7dc5a46714 {{(pid=118624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:33:22.355098 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-bff8aab9-0744-45d0-80bd-2b23fcdb2fd1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062379 Jun 14 18:33:22.359523 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 382/793] 10.222.0.78 () {58 vars in 1301 bytes} [Tue Jun 14 18:33:22 2022] GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:33:22.554622 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-403b6715-c002-449e-8af8-f93f7d35c280 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "DELETE /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714/os-volume_attachments/f8cbd24e-84de-4ad0-b181-46571c18b6d7" status: 202 len: 0 microversion: 2.1 time: 0.360676 Jun 14 18:33:22.556256 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 412/794] 10.222.0.78 () {58 vars in 1415 bytes} [Tue Jun 14 18:33:22 2022] DELETE /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714/os-volume_attachments/f8cbd24e-84de-4ad0-b181-46571c18b6d7 => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 14 18:33:22.567804 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-c15ceb74-c9f9-4ce1-aaeb-d57e7e0b4b03 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:22.567804 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-c15ceb74-c9f9-4ce1-aaeb-d57e7e0b4b03 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:22.572789 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c15ceb74-c9f9-4ce1-aaeb-d57e7e0b4b03 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:22.573574 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c15ceb74-c9f9-4ce1-aaeb-d57e7e0b4b03 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:22.575492 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c15ceb74-c9f9-4ce1-aaeb-d57e7e0b4b03 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:22.577311 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c15ceb74-c9f9-4ce1-aaeb-d57e7e0b4b03 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:22.807259 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-c15ceb74-c9f9-4ce1-aaeb-d57e7e0b4b03 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:22.817866 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-c15ceb74-c9f9-4ce1-aaeb-d57e7e0b4b03 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:22.819793 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-c15ceb74-c9f9-4ce1-aaeb-d57e7e0b4b03 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:22.820781 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-c15ceb74-c9f9-4ce1-aaeb-d57e7e0b4b03 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1723 microversion: 2.20 time: 0.260787 Jun 14 18:33:22.821335 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 383/795] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:33:22 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:33:23.313566 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-f6c84edf-6bf8-490c-8768-cf7a6722dbdc tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:23.315284 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-f6c84edf-6bf8-490c-8768-cf7a6722dbdc tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:23.322557 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f6c84edf-6bf8-490c-8768-cf7a6722dbdc tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:23.323121 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f6c84edf-6bf8-490c-8768-cf7a6722dbdc tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:23.323835 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f6c84edf-6bf8-490c-8768-cf7a6722dbdc tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:23.324281 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f6c84edf-6bf8-490c-8768-cf7a6722dbdc tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:23.370199 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-8089238b-8638-42a1-a0d2-4dde6cb84447 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:23.371379 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-8089238b-8638-42a1-a0d2-4dde6cb84447 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:23.380509 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8089238b-8638-42a1-a0d2-4dde6cb84447 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:23.381045 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8089238b-8638-42a1-a0d2-4dde6cb84447 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:23.381948 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8089238b-8638-42a1-a0d2-4dde6cb84447 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:23.382466 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8089238b-8638-42a1-a0d2-4dde6cb84447 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:23.419417 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-8089238b-8638-42a1-a0d2-4dde6cb84447 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053798 Jun 14 18:33:23.420632 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 384/796] 10.222.0.78 () {58 vars in 1301 bytes} [Tue Jun 14 18:33:23 2022] GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 14 18:33:23.488947 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-9eef085d-4c00-4602-b5be-e3b48108fc01 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:23.489437 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-9eef085d-4c00-4602-b5be-e3b48108fc01 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:23.503536 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9eef085d-4c00-4602-b5be-e3b48108fc01 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:23.504047 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9eef085d-4c00-4602-b5be-e3b48108fc01 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:23.504898 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9eef085d-4c00-4602-b5be-e3b48108fc01 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:23.505526 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9eef085d-4c00-4602-b5be-e3b48108fc01 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:23.521029 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-f6c84edf-6bf8-490c-8768-cf7a6722dbdc tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:23.536711 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-9eef085d-4c00-4602-b5be-e3b48108fc01 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] Going to try to terminate instance {{(pid=118623) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:33:23.545787 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-f6c84edf-6bf8-490c-8768-cf7a6722dbdc tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1520 microversion: 2.1 time: 0.228633 Jun 14 18:33:23.545787 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 413/797] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:23 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:23.842221 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-37a2c268-b060-4c8a-ba66-715eb6e1333b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:23.843131 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-37a2c268-b060-4c8a-ba66-715eb6e1333b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:23.849478 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-37a2c268-b060-4c8a-ba66-715eb6e1333b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:23.849934 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-37a2c268-b060-4c8a-ba66-715eb6e1333b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:23.850707 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-37a2c268-b060-4c8a-ba66-715eb6e1333b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:23.851149 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-37a2c268-b060-4c8a-ba66-715eb6e1333b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:23.902168 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-9eef085d-4c00-4602-b5be-e3b48108fc01 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "DELETE /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94" status: 204 len: 0 microversion: 2.1 time: 0.416621 Jun 14 18:33:23.904161 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 385/798] 10.222.0.78 () {58 vars in 1238 bytes} [Tue Jun 14 18:33:23 2022] DELETE /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 18:33:23.914077 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-4e58ce35-9e65-4643-9087-b9adaf158874 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:23.914870 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-4e58ce35-9e65-4643-9087-b9adaf158874 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:23.922416 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4e58ce35-9e65-4643-9087-b9adaf158874 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:23.922865 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4e58ce35-9e65-4643-9087-b9adaf158874 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:23.923649 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4e58ce35-9e65-4643-9087-b9adaf158874 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:23.924198 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4e58ce35-9e65-4643-9087-b9adaf158874 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:24.031440 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-37a2c268-b060-4c8a-ba66-715eb6e1333b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:24.045365 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-37a2c268-b060-4c8a-ba66-715eb6e1333b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:24.049143 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-37a2c268-b060-4c8a-ba66-715eb6e1333b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:24.049143 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-37a2c268-b060-4c8a-ba66-715eb6e1333b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1723 microversion: 2.20 time: 0.211115 Jun 14 18:33:24.049518 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 414/799] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:33:23 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:33:24.082908 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-4e58ce35-9e65-4643-9087-b9adaf158874 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:24.091652 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-4e58ce35-9e65-4643-9087-b9adaf158874 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94" status: 200 len: 1679 microversion: 2.1 time: 0.182834 Jun 14 18:33:24.092229 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 386/800] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:23 2022] GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94 => generated 1679 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:33:24.564158 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-9a603681-f110-44e7-8a24-d1d8d8e34aae tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:24.564743 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-9a603681-f110-44e7-8a24-d1d8d8e34aae tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:24.571556 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9a603681-f110-44e7-8a24-d1d8d8e34aae tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:24.571941 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9a603681-f110-44e7-8a24-d1d8d8e34aae tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:24.572705 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9a603681-f110-44e7-8a24-d1d8d8e34aae tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:24.573135 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9a603681-f110-44e7-8a24-d1d8d8e34aae tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:24.717207 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-9a603681-f110-44e7-8a24-d1d8d8e34aae tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:24.724760 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-9a603681-f110-44e7-8a24-d1d8d8e34aae tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1520 microversion: 2.1 time: 0.165544 Jun 14 18:33:24.725603 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 415/801] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:24 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:25.068174 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-17ec70ed-86b8-41a2-aa42-e033f6da4a3f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:25.068767 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-17ec70ed-86b8-41a2-aa42-e033f6da4a3f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:25.076692 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-17ec70ed-86b8-41a2-aa42-e033f6da4a3f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:25.077157 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-17ec70ed-86b8-41a2-aa42-e033f6da4a3f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:25.077937 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-17ec70ed-86b8-41a2-aa42-e033f6da4a3f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:25.078369 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-17ec70ed-86b8-41a2-aa42-e033f6da4a3f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:25.108755 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-d0162958-1c61-4571-8d58-d89958fd05a7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:25.109365 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-d0162958-1c61-4571-8d58-d89958fd05a7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:25.115693 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d0162958-1c61-4571-8d58-d89958fd05a7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:25.116154 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d0162958-1c61-4571-8d58-d89958fd05a7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:25.116943 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d0162958-1c61-4571-8d58-d89958fd05a7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:25.117386 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d0162958-1c61-4571-8d58-d89958fd05a7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:25.219208 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-17ec70ed-86b8-41a2-aa42-e033f6da4a3f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:25.227623 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-17ec70ed-86b8-41a2-aa42-e033f6da4a3f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:25.229128 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-17ec70ed-86b8-41a2-aa42-e033f6da4a3f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:25.230383 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-17ec70ed-86b8-41a2-aa42-e033f6da4a3f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1723 microversion: 2.20 time: 0.166437 Jun 14 18:33:25.230993 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 387/802] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:33:25 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:33:25.272163 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-d0162958-1c61-4571-8d58-d89958fd05a7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:25.279790 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-d0162958-1c61-4571-8d58-d89958fd05a7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94" status: 200 len: 1679 microversion: 2.1 time: 0.175232 Jun 14 18:33:25.280358 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 416/803] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:25 2022] GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94 => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:33:25.747657 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-71b8fe99-2699-4ae0-bedf-06fcb7b74c68 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:25.748352 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-71b8fe99-2699-4ae0-bedf-06fcb7b74c68 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:25.757702 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-71b8fe99-2699-4ae0-bedf-06fcb7b74c68 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:25.765951 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-71b8fe99-2699-4ae0-bedf-06fcb7b74c68 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:25.765951 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-71b8fe99-2699-4ae0-bedf-06fcb7b74c68 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:25.765951 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-71b8fe99-2699-4ae0-bedf-06fcb7b74c68 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:25.915701 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-71b8fe99-2699-4ae0-bedf-06fcb7b74c68 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:25.923869 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-71b8fe99-2699-4ae0-bedf-06fcb7b74c68 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1520 microversion: 2.1 time: 0.183367 Jun 14 18:33:25.924451 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 388/804] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:25 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:26.249495 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-2f031f90-0243-4b02-8b9e-8ca673332220 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:26.250851 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-2f031f90-0243-4b02-8b9e-8ca673332220 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:26.258590 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2f031f90-0243-4b02-8b9e-8ca673332220 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:26.259036 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2f031f90-0243-4b02-8b9e-8ca673332220 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:26.260085 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2f031f90-0243-4b02-8b9e-8ca673332220 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:26.260591 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2f031f90-0243-4b02-8b9e-8ca673332220 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:26.297830 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-2eb04a04-2b4c-49b8-8470-cc9cbb11fab3 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:26.298953 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-2eb04a04-2b4c-49b8-8470-cc9cbb11fab3 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:26.309827 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2eb04a04-2b4c-49b8-8470-cc9cbb11fab3 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:26.310514 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2eb04a04-2b4c-49b8-8470-cc9cbb11fab3 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:26.311340 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2eb04a04-2b4c-49b8-8470-cc9cbb11fab3 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:26.311804 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2eb04a04-2b4c-49b8-8470-cc9cbb11fab3 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:26.510540 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-2f031f90-0243-4b02-8b9e-8ca673332220 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:26.524034 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-2f031f90-0243-4b02-8b9e-8ca673332220 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:26.525685 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-2f031f90-0243-4b02-8b9e-8ca673332220 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:26.527146 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-2f031f90-0243-4b02-8b9e-8ca673332220 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1726 microversion: 2.20 time: 0.282789 Jun 14 18:33:26.528342 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 417/805] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:33:26 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1726 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:33:26.553634 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-8f83b8f2-6a55-4159-a671-78e502dd18f3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "334635cf-1a3e-42f9-b6b2-f3871c67b57f"}} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:33:26.554868 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-8f83b8f2-6a55-4159-a671-78e502dd18f3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:26.557980 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_api:SELECT=77 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:33:26.572047 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8f83b8f2-6a55-4159-a671-78e502dd18f3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:26.575429 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8f83b8f2-6a55-4159-a671-78e502dd18f3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:26.575429 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8f83b8f2-6a55-4159-a671-78e502dd18f3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:26.575429 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8f83b8f2-6a55-4159-a671-78e502dd18f3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:26.678291 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-2eb04a04-2b4c-49b8-8470-cc9cbb11fab3 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:26.687054 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-2eb04a04-2b4c-49b8-8470-cc9cbb11fab3 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94" status: 200 len: 1679 microversion: 2.1 time: 0.393536 Jun 14 18:33:26.687643 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 389/806] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:26 2022] GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94 => generated 1679 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:33:26.942184 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-479120a3-53db-4031-b7a1-52be47a0f747 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:26.942796 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-479120a3-53db-4031-b7a1-52be47a0f747 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:26.949273 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-479120a3-53db-4031-b7a1-52be47a0f747 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:26.950302 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-479120a3-53db-4031-b7a1-52be47a0f747 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:26.951085 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-479120a3-53db-4031-b7a1-52be47a0f747 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:26.951520 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-479120a3-53db-4031-b7a1-52be47a0f747 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:27.157258 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-479120a3-53db-4031-b7a1-52be47a0f747 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:27.169051 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-479120a3-53db-4031-b7a1-52be47a0f747 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1576 microversion: 2.1 time: 0.230803 Jun 14 18:33:27.191296 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 390/807] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:26 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1576 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:33:27.204885 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-44554f5f-a6b9-476e-9fac-a0e05b89630e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:27.208252 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-44554f5f-a6b9-476e-9fac-a0e05b89630e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 41923641-5855-4385-8905-cc7dc5a46714] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:27.218835 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-44554f5f-a6b9-476e-9fac-a0e05b89630e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:27.219554 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-44554f5f-a6b9-476e-9fac-a0e05b89630e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:27.220763 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-44554f5f-a6b9-476e-9fac-a0e05b89630e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:27.221352 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-44554f5f-a6b9-476e-9fac-a0e05b89630e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:27.286412 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-44554f5f-a6b9-476e-9fac-a0e05b89630e tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714/os-volume_attachments/7d5db2c6-b356-40b1-bff2-779df3c1ffde" status: 200 len: 194 microversion: 2.1 time: 0.093936 Jun 14 18:33:27.287051 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 391/808] 10.222.0.78 () {58 vars in 1412 bytes} [Tue Jun 14 18:33:27 2022] GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714/os-volume_attachments/7d5db2c6-b356-40b1-bff2-779df3c1ffde => generated 194 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:33:27.297526 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-3be6866e-64f5-4fca-a2d7-f56573c48e05 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:27.298167 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-3be6866e-64f5-4fca-a2d7-f56573c48e05 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 41923641-5855-4385-8905-cc7dc5a46714] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:27.305759 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3be6866e-64f5-4fca-a2d7-f56573c48e05 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:27.306647 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3be6866e-64f5-4fca-a2d7-f56573c48e05 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:27.307741 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3be6866e-64f5-4fca-a2d7-f56573c48e05 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:27.308447 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3be6866e-64f5-4fca-a2d7-f56573c48e05 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:27.419124 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.objects.instance [None req-3be6866e-64f5-4fca-a2d7-f56573c48e05 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lazy-loading 'services' on Instance uuid 41923641-5855-4385-8905-cc7dc5a46714 {{(pid=118623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:33:27.595087 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:33:27.686946 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-3be6866e-64f5-4fca-a2d7-f56573c48e05 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "DELETE /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714/os-volume_attachments/7d5db2c6-b356-40b1-bff2-779df3c1ffde" status: 202 len: 0 microversion: 2.1 time: 0.393148 Jun 14 18:33:27.688362 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 392/809] 10.222.0.78 () {58 vars in 1415 bytes} [Tue Jun 14 18:33:27 2022] DELETE /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714/os-volume_attachments/7d5db2c6-b356-40b1-bff2-779df3c1ffde => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 14 18:33:27.699278 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-fd580894-a5e2-4d75-8e6d-02bff60e853e req-b2fff554-8dc6-4596-bcd3-4d9f49bedb59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86678293-5e78-4bb0-9bc8-0a02da6d1a0b", "name": "network-vif-unplugged", "status": "completed", "tag": "9a48c21f-378c-4db8-a26f-6ed7263009cb"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:33:27.734897 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-fd580894-a5e2-4d75-8e6d-02bff60e853e req-b2fff554-8dc6-4596-bcd3-4d9f49bedb59 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:27.735372 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-fd580894-a5e2-4d75-8e6d-02bff60e853e req-b2fff554-8dc6-4596-bcd3-4d9f49bedb59 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:27.750384 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.compute.server_external_events [req-fd580894-a5e2-4d75-8e6d-02bff60e853e req-b2fff554-8dc6-4596-bcd3-4d9f49bedb59 service nova] Unable to find a host for instance 86678293-5e78-4bb0-9bc8-0a02da6d1a0b. Dropping event network-vif-unplugged {{(pid=118623) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 14 18:33:27.752320 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-fd580894-a5e2-4d75-8e6d-02bff60e853e req-b2fff554-8dc6-4596-bcd3-4d9f49bedb59 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.061584 Jun 14 18:33:27.755627 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 393/810] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 66 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 14 18:33:27.763929 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-8b6b083f-1e31-4b6d-ab17-1bfb5b68f83c req-c4be413f-f942-411d-b2ed-cdc079b116f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "678e536c-8e80-49f6-90d0-72aec54c7c94", "name": "network-vif-deleted", "tag": "93a39948-07fb-4640-aa06-c4c42c36d5f1"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:33:27.773616 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-8b6b083f-1e31-4b6d-ab17-1bfb5b68f83c req-c4be413f-f942-411d-b2ed-cdc079b116f4 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:27.774859 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-8b6b083f-1e31-4b6d-ab17-1bfb5b68f83c req-c4be413f-f942-411d-b2ed-cdc079b116f4 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:27.795583 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-8b6b083f-1e31-4b6d-ab17-1bfb5b68f83c req-c4be413f-f942-411d-b2ed-cdc079b116f4 service nova] Creating event network-vif-deleted:93a39948-07fb-4640-aa06-c4c42c36d5f1 for instance 678e536c-8e80-49f6-90d0-72aec54c7c94 on hv-cinder-84456 Jun 14 18:33:27.812698 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-8b6b083f-1e31-4b6d-ab17-1bfb5b68f83c req-c4be413f-f942-411d-b2ed-cdc079b116f4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055600 Jun 14 18:33:27.813310 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 394/811] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:33:27.856163 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-2dc0b64e-d10e-4ff6-b300-916fe95844e1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:27.869316 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-2dc0b64e-d10e-4ff6-b300-916fe95844e1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:27.889651 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2dc0b64e-d10e-4ff6-b300-916fe95844e1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:27.890319 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2dc0b64e-d10e-4ff6-b300-916fe95844e1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:27.891308 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2dc0b64e-d10e-4ff6-b300-916fe95844e1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:27.891918 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2dc0b64e-d10e-4ff6-b300-916fe95844e1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:27.936994 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-8f83b8f2-6a55-4159-a671-78e502dd18f3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "POST /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.390381 Jun 14 18:33:27.944659 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 418/812] 10.222.0.78 () {62 vars in 1363 bytes} [Tue Jun 14 18:33:26 2022] POST /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b/os-volume_attachments => generated 188 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 18:33:28.029626 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-2dc0b64e-d10e-4ff6-b300-916fe95844e1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:28.041385 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-2dc0b64e-d10e-4ff6-b300-916fe95844e1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94" status: 200 len: 1325 microversion: 2.1 time: 0.223509 Jun 14 18:33:28.046140 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 395/813] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:27 2022] GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94 => generated 1325 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:28.128801 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-44f9746e-74f1-408e-8347-7de548d84eae tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:28.131083 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-44f9746e-74f1-408e-8347-7de548d84eae tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:28.142506 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-44f9746e-74f1-408e-8347-7de548d84eae tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:28.143329 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-44f9746e-74f1-408e-8347-7de548d84eae tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:28.144367 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-44f9746e-74f1-408e-8347-7de548d84eae tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:28.145043 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-44f9746e-74f1-408e-8347-7de548d84eae tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:28.201346 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-5e7a630a-caf6-475e-8b18-78d105dc8703 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:28.201987 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-5e7a630a-caf6-475e-8b18-78d105dc8703 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:28.212496 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5e7a630a-caf6-475e-8b18-78d105dc8703 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:28.212927 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5e7a630a-caf6-475e-8b18-78d105dc8703 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:28.213954 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5e7a630a-caf6-475e-8b18-78d105dc8703 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:28.214614 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5e7a630a-caf6-475e-8b18-78d105dc8703 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:28.466935 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-5e7a630a-caf6-475e-8b18-78d105dc8703 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:28.480959 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-5e7a630a-caf6-475e-8b18-78d105dc8703 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1576 microversion: 2.1 time: 0.287588 Jun 14 18:33:28.482890 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 396/814] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:28 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1576 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:28.859515 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=6,nova_cell1:UPDATE=6 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:33:28.981553 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-44f9746e-74f1-408e-8347-7de548d84eae tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "DELETE /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b/os-volume_attachments/334635cf-1a3e-42f9-b6b2-f3871c67b57f" status: 202 len: 0 microversion: 2.20 time: 0.857985 Jun 14 18:33:28.982444 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 419/815] 10.222.0.78 () {60 vars in 1456 bytes} [Tue Jun 14 18:33:28 2022] DELETE /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b/os-volume_attachments/334635cf-1a3e-42f9-b6b2-f3871c67b57f => generated 0 bytes in 861 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 14 18:33:29.064987 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-e39bb423-4616-4e01-afdb-38d039daa2d2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:33:29.065886 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-8671459e-d8e1-40a1-9b1a-6d199fa93c0a tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:29.066068 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-e39bb423-4616-4e01-afdb-38d039daa2d2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:29.066733 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-8671459e-d8e1-40a1-9b1a-6d199fa93c0a tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:29.076706 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e39bb423-4616-4e01-afdb-38d039daa2d2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:29.076994 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8671459e-d8e1-40a1-9b1a-6d199fa93c0a tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:29.079605 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e39bb423-4616-4e01-afdb-38d039daa2d2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:29.079802 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8671459e-d8e1-40a1-9b1a-6d199fa93c0a tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:29.079963 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e39bb423-4616-4e01-afdb-38d039daa2d2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:29.080115 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8671459e-d8e1-40a1-9b1a-6d199fa93c0a tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:29.080267 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e39bb423-4616-4e01-afdb-38d039daa2d2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:29.080437 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8671459e-d8e1-40a1-9b1a-6d199fa93c0a tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:29.155667 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8671459e-d8e1-40a1-9b1a-6d199fa93c0a tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:29.156128 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8671459e-d8e1-40a1-9b1a-6d199fa93c0a tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:29.156593 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.objects.instance [None req-8671459e-d8e1-40a1-9b1a-6d199fa93c0a tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lazy-loading 'fault' on Instance uuid 678e536c-8e80-49f6-90d0-72aec54c7c94 {{(pid=118623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:33:29.220652 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-8671459e-d8e1-40a1-9b1a-6d199fa93c0a tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:29.232427 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-8671459e-d8e1-40a1-9b1a-6d199fa93c0a tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94" status: 200 len: 1330 microversion: 2.1 time: 0.173522 Jun 14 18:33:29.233904 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 397/816] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:29 2022] GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94 => generated 1330 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:29.499239 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-ccda1c5c-a852-41a4-aa35-1ecc382a8391 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:29.499900 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-ccda1c5c-a852-41a4-aa35-1ecc382a8391 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:29.506279 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ccda1c5c-a852-41a4-aa35-1ecc382a8391 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:29.506772 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ccda1c5c-a852-41a4-aa35-1ecc382a8391 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:29.507494 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ccda1c5c-a852-41a4-aa35-1ecc382a8391 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:29.507923 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ccda1c5c-a852-41a4-aa35-1ecc382a8391 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:29.589117 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-e39bb423-4616-4e01-afdb-38d039daa2d2 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "POST /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b/action" status: 202 len: 0 microversion: 2.20 time: 0.528055 Jun 14 18:33:29.589782 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 420/817] 10.222.0.78 () {62 vars in 1318 bytes} [Tue Jun 14 18:33:29 2022] POST /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b/action => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 14 18:33:29.601526 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-e0de9bc2-1dff-48c3-bcb8-441099ea9cba tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:29.601692 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-e0de9bc2-1dff-48c3-bcb8-441099ea9cba tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:29.612907 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e0de9bc2-1dff-48c3-bcb8-441099ea9cba tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:29.613632 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e0de9bc2-1dff-48c3-bcb8-441099ea9cba tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:29.614725 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e0de9bc2-1dff-48c3-bcb8-441099ea9cba tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:29.618954 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e0de9bc2-1dff-48c3-bcb8-441099ea9cba tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:29.704582 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-ccda1c5c-a852-41a4-aa35-1ecc382a8391 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:29.714564 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-ccda1c5c-a852-41a4-aa35-1ecc382a8391 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1576 microversion: 2.1 time: 0.217713 Jun 14 18:33:29.716346 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 398/818] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:29 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1576 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:33:29.827980 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-e0de9bc2-1dff-48c3-bcb8-441099ea9cba tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:29.836969 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-e0de9bc2-1dff-48c3-bcb8-441099ea9cba tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:29.838592 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-e0de9bc2-1dff-48c3-bcb8-441099ea9cba tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:29.839823 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-e0de9bc2-1dff-48c3-bcb8-441099ea9cba tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1674 microversion: 2.20 time: 0.245004 Jun 14 18:33:29.840586 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 421/819] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:33:29 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1674 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:33:30.164635 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-78bf1ad5-024d-4129-b948-45ea563f9c01 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:30.166409 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-78bf1ad5-024d-4129-b948-45ea563f9c01 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 41923641-5855-4385-8905-cc7dc5a46714] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:30.172867 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-78bf1ad5-024d-4129-b948-45ea563f9c01 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:30.173318 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-78bf1ad5-024d-4129-b948-45ea563f9c01 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:30.174127 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-78bf1ad5-024d-4129-b948-45ea563f9c01 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:30.175854 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-78bf1ad5-024d-4129-b948-45ea563f9c01 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:30.207667 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-78bf1ad5-024d-4129-b948-45ea563f9c01 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046957 Jun 14 18:33:30.208825 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 399/820] 10.222.0.78 () {58 vars in 1301 bytes} [Tue Jun 14 18:33:30 2022] GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 14 18:33:30.265606 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-32ae7606-2a1f-417b-ade9-967ca9642143 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:30.266262 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-32ae7606-2a1f-417b-ade9-967ca9642143 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:30.274171 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-32ae7606-2a1f-417b-ade9-967ca9642143 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:30.274752 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-32ae7606-2a1f-417b-ade9-967ca9642143 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:30.275743 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-32ae7606-2a1f-417b-ade9-967ca9642143 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:30.276164 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-32ae7606-2a1f-417b-ade9-967ca9642143 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:30.295215 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.wsgi [None req-32ae7606-2a1f-417b-ade9-967ca9642143 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] HTTP exception thrown: Instance 678e536c-8e80-49f6-90d0-72aec54c7c94 could not be found. Jun 14 18:33:30.297000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-32ae7606-2a1f-417b-ade9-967ca9642143 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Request method failure captured: Jun 14 18:33:30.297000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: request: GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94 HTTP/1.1 Jun 14 18:33:30.297000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept: application/json Jun 14 18:33:30.297000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept-Encoding: identity Jun 14 18:33:30.297000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Connection: close Jun 14 18:33:30.297000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Length: 0 Jun 14 18:33:30.297000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Type: application/json Jun 14 18:33:30.297000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Host: 10.222.0.78 Jun 14 18:33:30.297000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Openstack-System-Scope: None Jun 14 18:33:30.297000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: User-Agent: python-urllib3/1.26.9 Jun 14 18:33:30.297000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Auth-Token: gAAAAABiqNNRwUW-ILUkPK_wgILFSFKwt3erUOv38mYIB0oCeDDiotO112_xIQykQF206CMg3446rqZisR6hzfab3579MeUncL30z5LdS-2pD1weLSQ2dqyxdVYPdVwx-jGbuP7Kwf2vbYNW1CdwMR0V5q1_4RRQAdNuD7UVUw8E8v9L5saJIsU Jun 14 18:33:30.297000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Id: None Jun 14 18:33:30.297000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Name: None Jun 14 18:33:30.297000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Identity-Status: Confirmed Jun 14 18:33:30.297000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Is-Admin-Project: True Jun 14 18:33:30.297000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Id: default Jun 14 18:33:30.297000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Name: Default Jun 14 18:33:30.297000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Id: 56f8367a52044e82a2c272da39e1bfd8 Jun 14 18:33:30.297000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Name: tempest-AttachVolumeNegativeTest-1598181014 Jun 14 18:33:30.297000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Role: reader,member Jun 14 18:33:30.297000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Roles: reader,member Jun 14 18:33:30.304726 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_56f8367a52044e82a2c272da39e1bfd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/56f8367a52044e82a2c272da39e1bfd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/56f8367a52044e82a2c272da39e1bfd8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/56f8367a52044e82a2c272da39e1bfd8"}]}] Jun 14 18:33:30.304726 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant: tempest-AttachVolumeNegativeTest-1598181014 Jun 14 18:33:30.304726 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Id: 56f8367a52044e82a2c272da39e1bfd8 Jun 14 18:33:30.304726 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1598181014 Jun 14 18:33:30.304726 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User: tempest-AttachVolumeNegativeTest-1598181014-project Jun 14 18:33:30.304726 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Id: default Jun 14 18:33:30.304726 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Name: Default Jun 14 18:33:30.304726 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Id: 9254bd46822346009497b01d28314335 Jun 14 18:33:30.304726 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Name: tempest-AttachVolumeNegativeTest-1598181014-project Jun 14 18:33:30.304726 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: method: > Jun 14 18:33:30.304726 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: exception: Instance 678e536c-8e80-49f6-90d0-72aec54c7c94 could not be found. Jun 14 18:33:30.304726 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: action_args: {'id': '678e536c-8e80-49f6-90d0-72aec54c7c94'} Jun 14 18:33:30.306984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:33:30.306984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:33:30.306984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:33:30.306984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:33:30.306984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:33:30.306984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:33:30.306984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:33:30.306984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:33:30.306984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:33:30.306984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:33:30.306984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 678e536c-8e80-49f6-90d0-72aec54c7c94 could not be found. Jun 14 18:33:30.306984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:33:30.306984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:33:30.306984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:33:30.306984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:33:30.306984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:33:30.306984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:33:30.306984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:33:30.306984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:33:30.306984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:33:30.309352 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:33:30.309352 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:33:30.309352 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:33:30.309352 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:33:30.309352 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:33:30.309352 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:33:30.309352 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:33:30.309352 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 678e536c-8e80-49f6-90d0-72aec54c7c94 could not be found. Jun 14 18:33:30.309352 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:33:30.309352 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:33:30.309352 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:33:30.309352 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:33:30.309352 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:33:30.309352 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:33:30.309352 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:33:30.309352 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:33:30.309352 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 678e536c-8e80-49f6-90d0-72aec54c7c94 could not be found. Jun 14 18:33:30.309352 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:33:30.310828 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-32ae7606-2a1f-417b-ade9-967ca9642143 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Returning 404 to user: Instance 678e536c-8e80-49f6-90d0-72aec54c7c94 could not be found. {{(pid=118624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:33:30.310828 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-32ae7606-2a1f-417b-ade9-967ca9642143 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94" status: 404 len: 111 microversion: 2.1 time: 0.038149 Jun 14 18:33:30.310828 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 422/821] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:30 2022] GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:33:30.311534 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-93a20e48-0b08-4037-9481-4457508c3b28 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '.version_select at 0x7efe70a6d310>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:30.349240 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-2030aefc-937e-4b67-a24d-494d9a7b3900 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:30.350361 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-2030aefc-937e-4b67-a24d-494d9a7b3900 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 41923641-5855-4385-8905-cc7dc5a46714] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:30.357049 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2030aefc-937e-4b67-a24d-494d9a7b3900 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:30.357326 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2030aefc-937e-4b67-a24d-494d9a7b3900 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:30.358243 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2030aefc-937e-4b67-a24d-494d9a7b3900 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:30.358686 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2030aefc-937e-4b67-a24d-494d9a7b3900 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:30.390798 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-2030aefc-937e-4b67-a24d-494d9a7b3900 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045484 Jun 14 18:33:30.391698 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 423/822] 10.222.0.78 () {58 vars in 1301 bytes} [Tue Jun 14 18:33:30 2022] GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 14 18:33:30.440990 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-93a20e48-0b08-4037-9481-4457508c3b28 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-573521088" status: 202 len: 0 microversion: 2.1 time: 0.135752 Jun 14 18:33:30.442108 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 400/823] 10.222.0.78 () {58 vars in 1217 bytes} [Tue Jun 14 18:33:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-573521088 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 14 18:33:30.491571 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-d5d69c6e-a01c-48a4-8c4a-6982d7b9cab6 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:30.494742 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-d5d69c6e-a01c-48a4-8c4a-6982d7b9cab6 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 41923641-5855-4385-8905-cc7dc5a46714] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:30.499960 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d5d69c6e-a01c-48a4-8c4a-6982d7b9cab6 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:30.500691 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d5d69c6e-a01c-48a4-8c4a-6982d7b9cab6 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:30.501737 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d5d69c6e-a01c-48a4-8c4a-6982d7b9cab6 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:30.502250 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d5d69c6e-a01c-48a4-8c4a-6982d7b9cab6 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:30.529572 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-d5d69c6e-a01c-48a4-8c4a-6982d7b9cab6 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 41923641-5855-4385-8905-cc7dc5a46714] Going to try to terminate instance {{(pid=118624) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:33:30.734060 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-2dc24a67-a9cc-4856-bea0-95bc7b475a6a tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:30.734675 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-2dc24a67-a9cc-4856-bea0-95bc7b475a6a tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:30.742910 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2dc24a67-a9cc-4856-bea0-95bc7b475a6a tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:30.743364 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2dc24a67-a9cc-4856-bea0-95bc7b475a6a tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:30.744126 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2dc24a67-a9cc-4856-bea0-95bc7b475a6a tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:30.744586 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2dc24a67-a9cc-4856-bea0-95bc7b475a6a tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:30.961000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-d5d69c6e-a01c-48a4-8c4a-6982d7b9cab6 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "DELETE /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714" status: 204 len: 0 microversion: 2.1 time: 0.473041 Jun 14 18:33:30.962000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 424/824] 10.222.0.78 () {58 vars in 1238 bytes} [Tue Jun 14 18:33:30 2022] DELETE /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 18:33:30.978763 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-619ab49c-b404-4502-a6c5-9eaaea7e828e tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:30.980049 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-619ab49c-b404-4502-a6c5-9eaaea7e828e tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:30.987837 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-619ab49c-b404-4502-a6c5-9eaaea7e828e tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:30.988566 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-619ab49c-b404-4502-a6c5-9eaaea7e828e tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:30.999336 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-619ab49c-b404-4502-a6c5-9eaaea7e828e tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:31.002607 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-619ab49c-b404-4502-a6c5-9eaaea7e828e tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:31.067535 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-2dc24a67-a9cc-4856-bea0-95bc7b475a6a tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:31.076649 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-2dc24a67-a9cc-4856-bea0-95bc7b475a6a tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1576 microversion: 2.1 time: 0.348229 Jun 14 18:33:31.093798 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 401/825] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:30 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1576 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:33:31.093798 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-5356ad82-371c-477b-994c-196c8260d2d7 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:31.093798 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-5356ad82-371c-477b-994c-196c8260d2d7 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 41923641-5855-4385-8905-cc7dc5a46714] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:31.100961 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5356ad82-371c-477b-994c-196c8260d2d7 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:31.101536 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5356ad82-371c-477b-994c-196c8260d2d7 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:31.102387 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5356ad82-371c-477b-994c-196c8260d2d7 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:31.102968 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5356ad82-371c-477b-994c-196c8260d2d7 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:31.179454 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-619ab49c-b404-4502-a6c5-9eaaea7e828e tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:31.188935 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-619ab49c-b404-4502-a6c5-9eaaea7e828e tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:31.190460 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-619ab49c-b404-4502-a6c5-9eaaea7e828e tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:31.191779 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-619ab49c-b404-4502-a6c5-9eaaea7e828e tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1674 microversion: 2.20 time: 0.218420 Jun 14 18:33:31.192340 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 425/826] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:33:30 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1674 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:33:31.329163 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-5356ad82-371c-477b-994c-196c8260d2d7 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:31.338282 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-5356ad82-371c-477b-994c-196c8260d2d7 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714" status: 200 len: 1673 microversion: 2.1 time: 0.250255 Jun 14 18:33:31.338853 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 402/827] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:31 2022] GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714 => generated 1673 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:31.566999 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-0faa13c6-a881-4fcb-9c10-3d0392129550 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Action: 'create', calling method: .version_select at 0x7efe706bb160>, body: {"keypair": {"name": "tempest-keypair-48154676", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJncprPnPjwzcbmhbMf4TqLHSKQKqTw3Fi+2q32uUxRn2a3qqOy9B6ry6eoxW6ouYc+W5kHFPi3XS2YgkyhXy69lSf4G/MWjE6jhJIE+uhxMV625fHMA+N1pmuYdBsoOyg=="}} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:33:31.581969 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.quota [None req-0faa13c6-a881-4fcb-9c10-3d0392129550 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Getting quotas for project 56f8367a52044e82a2c272da39e1bfd8. Resources: {'key_pairs'} {{(pid=118624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:33:31.585791 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.quota [None req-0faa13c6-a881-4fcb-9c10-3d0392129550 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Getting quotas for user 9254bd46822346009497b01d28314335 and project 56f8367a52044e82a2c272da39e1bfd8. Resources: {'key_pairs'} {{(pid=118624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:33:31.707271 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-0faa13c6-a881-4fcb-9c10-3d0392129550 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.144084 Jun 14 18:33:31.707875 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 426/828] 10.222.0.78 () {60 vars in 1158 bytes} [Tue Jun 14 18:33:31 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:33:32.094347 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-0104038b-561a-4d9f-aa5e-66d0526bf1aa tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:32.094994 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-0104038b-561a-4d9f-aa5e-66d0526bf1aa tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:32.101801 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0104038b-561a-4d9f-aa5e-66d0526bf1aa tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:32.102255 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0104038b-561a-4d9f-aa5e-66d0526bf1aa tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:32.103037 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0104038b-561a-4d9f-aa5e-66d0526bf1aa tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:32.103471 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0104038b-561a-4d9f-aa5e-66d0526bf1aa tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:32.211903 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-6e63831d-a29e-452b-8558-bad4f04d1bb0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:32.213071 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-6e63831d-a29e-452b-8558-bad4f04d1bb0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:32.221217 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6e63831d-a29e-452b-8558-bad4f04d1bb0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:32.221977 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6e63831d-a29e-452b-8558-bad4f04d1bb0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:32.222909 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6e63831d-a29e-452b-8558-bad4f04d1bb0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:32.223349 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6e63831d-a29e-452b-8558-bad4f04d1bb0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:32.286977 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-0104038b-561a-4d9f-aa5e-66d0526bf1aa tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:32.297355 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-0104038b-561a-4d9f-aa5e-66d0526bf1aa tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1576 microversion: 2.1 time: 0.208015 Jun 14 18:33:32.297996 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 403/829] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:32 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1576 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:32.358282 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-9c74d91c-7c30-4606-abe2-1415733dd668 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:32.358912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-9c74d91c-7c30-4606-abe2-1415733dd668 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 41923641-5855-4385-8905-cc7dc5a46714] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:32.367337 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9c74d91c-7c30-4606-abe2-1415733dd668 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:32.368058 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9c74d91c-7c30-4606-abe2-1415733dd668 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:32.369077 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9c74d91c-7c30-4606-abe2-1415733dd668 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:32.369548 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9c74d91c-7c30-4606-abe2-1415733dd668 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:32.390984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-6e63831d-a29e-452b-8558-bad4f04d1bb0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:32.402236 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-6e63831d-a29e-452b-8558-bad4f04d1bb0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:32.405191 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-6e63831d-a29e-452b-8558-bad4f04d1bb0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:32.406535 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-6e63831d-a29e-452b-8558-bad4f04d1bb0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1676 microversion: 2.20 time: 0.199042 Jun 14 18:33:32.407959 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 427/830] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:33:32 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1676 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:33:32.542493 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-9c74d91c-7c30-4606-abe2-1415733dd668 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:32.551427 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-9c74d91c-7c30-4606-abe2-1415733dd668 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714" status: 200 len: 1673 microversion: 2.1 time: 0.198185 Jun 14 18:33:32.552183 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 404/831] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:32 2022] GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714 => generated 1673 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:33:33.316344 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-c95c6cb8-c5a9-4a94-92f2-bc812e15f85f tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:33.318094 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-c95c6cb8-c5a9-4a94-92f2-bc812e15f85f tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:33.325540 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c95c6cb8-c5a9-4a94-92f2-bc812e15f85f tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:33.325991 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c95c6cb8-c5a9-4a94-92f2-bc812e15f85f tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:33.326947 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c95c6cb8-c5a9-4a94-92f2-bc812e15f85f tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:33.327682 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c95c6cb8-c5a9-4a94-92f2-bc812e15f85f tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:33.441078 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-afa742b0-950f-4bd6-bd85-b5e5a0e5cf09 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:33.441968 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-afa742b0-950f-4bd6-bd85-b5e5a0e5cf09 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:33.450862 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-afa742b0-950f-4bd6-bd85-b5e5a0e5cf09 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:33.451735 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-afa742b0-950f-4bd6-bd85-b5e5a0e5cf09 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:33.452618 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-afa742b0-950f-4bd6-bd85-b5e5a0e5cf09 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:33.453152 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-afa742b0-950f-4bd6-bd85-b5e5a0e5cf09 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:33.553293 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-c95c6cb8-c5a9-4a94-92f2-bc812e15f85f tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:33.565724 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-c95c6cb8-c5a9-4a94-92f2-bc812e15f85f tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1576 microversion: 2.1 time: 0.253281 Jun 14 18:33:33.576309 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 428/832] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:33 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1576 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:33.581695 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-600d2b52-517f-4548-a96e-6cb2834ba8e8 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:33.582515 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-600d2b52-517f-4548-a96e-6cb2834ba8e8 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 41923641-5855-4385-8905-cc7dc5a46714] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:33.602535 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-600d2b52-517f-4548-a96e-6cb2834ba8e8 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:33.602535 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-600d2b52-517f-4548-a96e-6cb2834ba8e8 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:33.602535 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-600d2b52-517f-4548-a96e-6cb2834ba8e8 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:33.602535 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-600d2b52-517f-4548-a96e-6cb2834ba8e8 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:33.718517 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-600d2b52-517f-4548-a96e-6cb2834ba8e8 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:33.718517 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-600d2b52-517f-4548-a96e-6cb2834ba8e8 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714" status: 200 len: 1605 microversion: 2.1 time: 0.129556 Jun 14 18:33:33.718517 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 429/833] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:33 2022] GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714 => generated 1605 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:33.943901 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-afa742b0-950f-4bd6-bd85-b5e5a0e5cf09 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:33.968289 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-afa742b0-950f-4bd6-bd85-b5e5a0e5cf09 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:33.971927 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-afa742b0-950f-4bd6-bd85-b5e5a0e5cf09 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:33.973493 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-afa742b0-950f-4bd6-bd85-b5e5a0e5cf09 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1732 microversion: 2.20 time: 0.536994 Jun 14 18:33:33.977756 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 405/834] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:33:33 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1732 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:33:33.993808 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-31ee921d-bfbc-4334-bd2b-31bad4bbabdb req-6c14cf07-8fc3-4d91-bab8-8ba494c8ecc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41923641-5855-4385-8905-cc7dc5a46714", "name": "network-vif-deleted", "tag": "1754f2cd-b7cf-4e61-9902-e19aa00b1cb0"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:33:34.007953 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-31ee921d-bfbc-4334-bd2b-31bad4bbabdb req-6c14cf07-8fc3-4d91-bab8-8ba494c8ecc9 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:34.008555 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-31ee921d-bfbc-4334-bd2b-31bad4bbabdb req-6c14cf07-8fc3-4d91-bab8-8ba494c8ecc9 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:34.021765 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-31ee921d-bfbc-4334-bd2b-31bad4bbabdb req-6c14cf07-8fc3-4d91-bab8-8ba494c8ecc9 service nova] Creating event network-vif-deleted:1754f2cd-b7cf-4e61-9902-e19aa00b1cb0 for instance 41923641-5855-4385-8905-cc7dc5a46714 on hv-cinder-84456 Jun 14 18:33:34.027316 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-31ee921d-bfbc-4334-bd2b-31bad4bbabdb req-6c14cf07-8fc3-4d91-bab8-8ba494c8ecc9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.306854 Jun 14 18:33:34.032809 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 430/835] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:33:34.583858 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-f41013d7-2d4d-43ad-847d-125fc174d237 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:34.584474 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-f41013d7-2d4d-43ad-847d-125fc174d237 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:34.591987 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f41013d7-2d4d-43ad-847d-125fc174d237 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:34.592439 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f41013d7-2d4d-43ad-847d-125fc174d237 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:34.593219 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f41013d7-2d4d-43ad-847d-125fc174d237 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:34.593699 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f41013d7-2d4d-43ad-847d-125fc174d237 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:34.726969 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-6c7ae4a8-dde4-46f2-89ab-b1358d87d5c4 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:34.727674 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-6c7ae4a8-dde4-46f2-89ab-b1358d87d5c4 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 41923641-5855-4385-8905-cc7dc5a46714] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:34.734884 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6c7ae4a8-dde4-46f2-89ab-b1358d87d5c4 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:34.735583 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6c7ae4a8-dde4-46f2-89ab-b1358d87d5c4 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:34.746892 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6c7ae4a8-dde4-46f2-89ab-b1358d87d5c4 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:34.746892 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6c7ae4a8-dde4-46f2-89ab-b1358d87d5c4 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:34.783981 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6c7ae4a8-dde4-46f2-89ab-b1358d87d5c4 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:34.785069 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6c7ae4a8-dde4-46f2-89ab-b1358d87d5c4 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:34.785766 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.objects.instance [None req-6c7ae4a8-dde4-46f2-89ab-b1358d87d5c4 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lazy-loading 'fault' on Instance uuid 41923641-5855-4385-8905-cc7dc5a46714 {{(pid=118624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:33:34.812895 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-f41013d7-2d4d-43ad-847d-125fc174d237 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:34.824336 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-f41013d7-2d4d-43ad-847d-125fc174d237 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1576 microversion: 2.1 time: 0.244565 Jun 14 18:33:34.833941 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 406/836] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:34 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1576 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:34.856049 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-6c7ae4a8-dde4-46f2-89ab-b1358d87d5c4 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:34.866171 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-6c7ae4a8-dde4-46f2-89ab-b1358d87d5c4 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714" status: 200 len: 1327 microversion: 2.1 time: 0.143836 Jun 14 18:33:34.872350 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 431/837] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:34 2022] GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714 => generated 1327 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:33:34.995524 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-f17a1a94-4507-4ec3-bb2c-4e252f1c450b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:34.996128 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-f17a1a94-4507-4ec3-bb2c-4e252f1c450b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:35.003079 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f17a1a94-4507-4ec3-bb2c-4e252f1c450b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:35.003524 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f17a1a94-4507-4ec3-bb2c-4e252f1c450b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:35.004292 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f17a1a94-4507-4ec3-bb2c-4e252f1c450b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:35.004730 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f17a1a94-4507-4ec3-bb2c-4e252f1c450b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:35.434142 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-f17a1a94-4507-4ec3-bb2c-4e252f1c450b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:35.442232 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-f17a1a94-4507-4ec3-bb2c-4e252f1c450b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:35.443724 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-f17a1a94-4507-4ec3-bb2c-4e252f1c450b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:35.444914 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-f17a1a94-4507-4ec3-bb2c-4e252f1c450b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1732 microversion: 2.20 time: 0.453286 Jun 14 18:33:35.445478 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 407/838] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:33:34 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1732 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:33:35.561216 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-3cc173a9-c169-4cbc-aada-5a4a9573c843 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-76998672", "imageRef": "e2555120-8576-4128-944f-40805aa95a9b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e21b4aaa-368c-485d-acb4-337720920cc4"}], "security_groups": [{"name": "tempest-securitygroup--193629007"}], "key_name": "tempest-keypair-48154676", "user_data": "}} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:33:35.660510 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.network.neutron [None req-3cc173a9-c169-4cbc-aada-5a4a9573c843 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] validate_networks() for [('e21b4aaa-368c-485d-acb4-337720920cc4', None, None, None, None, None)] {{(pid=118624) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 18:33:35.850334 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-436eadfa-45ec-49e6-8eda-9fd3ec5642d0 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:35.850951 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-436eadfa-45ec-49e6-8eda-9fd3ec5642d0 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:35.857907 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-436eadfa-45ec-49e6-8eda-9fd3ec5642d0 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:35.858321 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-436eadfa-45ec-49e6-8eda-9fd3ec5642d0 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:35.859099 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-436eadfa-45ec-49e6-8eda-9fd3ec5642d0 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:35.859534 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-436eadfa-45ec-49e6-8eda-9fd3ec5642d0 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:35.991988 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-436eadfa-45ec-49e6-8eda-9fd3ec5642d0 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:36.000388 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-436eadfa-45ec-49e6-8eda-9fd3ec5642d0 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1576 microversion: 2.1 time: 0.153931 Jun 14 18:33:36.000931 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 408/839] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:35 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:33:36.005838 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-f2ea23eb-da27-4e3e-895a-bb68b014d6d1 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:36.006519 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-f2ea23eb-da27-4e3e-895a-bb68b014d6d1 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 41923641-5855-4385-8905-cc7dc5a46714] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:36.012927 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f2ea23eb-da27-4e3e-895a-bb68b014d6d1 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:36.013376 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f2ea23eb-da27-4e3e-895a-bb68b014d6d1 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:36.014179 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f2ea23eb-da27-4e3e-895a-bb68b014d6d1 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:36.014615 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f2ea23eb-da27-4e3e-895a-bb68b014d6d1 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:36.027482 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-3cc173a9-c169-4cbc-aada-5a4a9573c843 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Flavor limits 0:0:0 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 18:33:36.028011 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-3cc173a9-c169-4cbc-aada-5a4a9573c843 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Image limits 0:0:0 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 18:33:36.028407 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-3cc173a9-c169-4cbc-aada-5a4a9573c843 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Flavor pref 0:0:0 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 18:33:36.028812 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-3cc173a9-c169-4cbc-aada-5a4a9573c843 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Image pref 0:0:0 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 18:33:36.029217 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-3cc173a9-c169-4cbc-aada-5a4a9573c843 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 18:33:36.037933 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3cc173a9-c169-4cbc-aada-5a4a9573c843 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:36.038379 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3cc173a9-c169-4cbc-aada-5a4a9573c843 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:36.039171 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3cc173a9-c169-4cbc-aada-5a4a9573c843 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:36.039603 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3cc173a9-c169-4cbc-aada-5a4a9573c843 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:36.046662 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f2ea23eb-da27-4e3e-895a-bb68b014d6d1 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:36.047110 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f2ea23eb-da27-4e3e-895a-bb68b014d6d1 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:36.047565 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.objects.instance [None req-f2ea23eb-da27-4e3e-895a-bb68b014d6d1 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lazy-loading 'fault' on Instance uuid 41923641-5855-4385-8905-cc7dc5a46714 {{(pid=118623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:33:36.057424 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.quota [None req-3cc173a9-c169-4cbc-aada-5a4a9573c843 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Getting quotas for project 56f8367a52044e82a2c272da39e1bfd8. Resources: {'instances', 'cores', 'ram'} {{(pid=118624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:33:36.062884 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.quota [None req-3cc173a9-c169-4cbc-aada-5a4a9573c843 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Getting quotas for user 9254bd46822346009497b01d28314335 and project 56f8367a52044e82a2c272da39e1bfd8. Resources: {'instances', 'cores', 'ram'} {{(pid=118624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:33:36.074415 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-3cc173a9-c169-4cbc-aada-5a4a9573c843 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Going to run 1 instances... {{(pid=118624) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 18:33:36.076701 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-3cc173a9-c169-4cbc-aada-5a4a9573c843 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e2555120-8576-4128-944f-40805aa95a9b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118624) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 18:33:36.089251 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-f2ea23eb-da27-4e3e-895a-bb68b014d6d1 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:36.101390 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-f2ea23eb-da27-4e3e-895a-bb68b014d6d1 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714" status: 200 len: 1327 microversion: 2.1 time: 0.099047 Jun 14 18:33:36.102695 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 409/840] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:36 2022] GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714 => generated 1327 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:36.236176 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-3cc173a9-c169-4cbc-aada-5a4a9573c843 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.680212 Jun 14 18:33:36.236834 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 432/841] 10.222.0.78 () {60 vars in 1146 bytes} [Tue Jun 14 18:33:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 18:33:36.247541 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-1d96c2f9-8622-40ef-b8f6-2c80791431b0 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:36.248154 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-1d96c2f9-8622-40ef-b8f6-2c80791431b0 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:36.310492 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-1d96c2f9-8622-40ef-b8f6-2c80791431b0 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:36.322110 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-1d96c2f9-8622-40ef-b8f6-2c80791431b0 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1" status: 200 len: 1238 microversion: 2.1 time: 0.078547 Jun 14 18:33:36.323183 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 410/842] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:36 2022] GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1 => generated 1238 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:36.463936 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-89016932-d976-4fd2-8595-2556d8837f90 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:36.464557 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-89016932-d976-4fd2-8595-2556d8837f90 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:36.472667 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-89016932-d976-4fd2-8595-2556d8837f90 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:36.473118 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-89016932-d976-4fd2-8595-2556d8837f90 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:36.473976 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-89016932-d976-4fd2-8595-2556d8837f90 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:36.474412 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-89016932-d976-4fd2-8595-2556d8837f90 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:36.617090 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-89016932-d976-4fd2-8595-2556d8837f90 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:36.625984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-89016932-d976-4fd2-8595-2556d8837f90 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:36.627487 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-89016932-d976-4fd2-8595-2556d8837f90 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:36.628637 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-89016932-d976-4fd2-8595-2556d8837f90 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1732 microversion: 2.20 time: 0.168826 Jun 14 18:33:36.629240 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 433/843] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:33:36 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:33:37.017549 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-8bd684d1-26c6-4e68-9c41-78b42d1dc816 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:37.018160 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-8bd684d1-26c6-4e68-9c41-78b42d1dc816 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:37.024818 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8bd684d1-26c6-4e68-9c41-78b42d1dc816 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:37.025263 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8bd684d1-26c6-4e68-9c41-78b42d1dc816 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:37.026063 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8bd684d1-26c6-4e68-9c41-78b42d1dc816 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:37.026499 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8bd684d1-26c6-4e68-9c41-78b42d1dc816 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:37.120403 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-46aa28d0-99fe-4cb5-a268-bc9367513834 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:37.121214 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-46aa28d0-99fe-4cb5-a268-bc9367513834 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 41923641-5855-4385-8905-cc7dc5a46714] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:37.128255 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-46aa28d0-99fe-4cb5-a268-bc9367513834 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:37.128694 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-46aa28d0-99fe-4cb5-a268-bc9367513834 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:37.129476 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-46aa28d0-99fe-4cb5-a268-bc9367513834 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:37.129914 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-46aa28d0-99fe-4cb5-a268-bc9367513834 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:37.170644 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-46aa28d0-99fe-4cb5-a268-bc9367513834 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:37.171164 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-46aa28d0-99fe-4cb5-a268-bc9367513834 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:37.176268 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.objects.instance [None req-46aa28d0-99fe-4cb5-a268-bc9367513834 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lazy-loading 'fault' on Instance uuid 41923641-5855-4385-8905-cc7dc5a46714 {{(pid=118624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:33:37.199334 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-8bd684d1-26c6-4e68-9c41-78b42d1dc816 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:37.207221 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-8bd684d1-26c6-4e68-9c41-78b42d1dc816 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1576 microversion: 2.1 time: 0.193565 Jun 14 18:33:37.208004 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 411/844] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:37 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1576 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:37.215403 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-46aa28d0-99fe-4cb5-a268-bc9367513834 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922fd1f30c7647fdb19f8f67a39223cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f771a602054b349adae092a9d3ed24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:37.223037 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-46aa28d0-99fe-4cb5-a268-bc9367513834 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714" status: 200 len: 1327 microversion: 2.1 time: 0.106783 Jun 14 18:33:37.223598 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 434/845] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:37 2022] GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714 => generated 1327 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:33:37.342726 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-f776bb26-2c40-48a3-ab2f-38c9a065d843 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:37.343528 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-f776bb26-2c40-48a3-ab2f-38c9a065d843 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:37.350582 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f776bb26-2c40-48a3-ab2f-38c9a065d843 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:37.350959 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f776bb26-2c40-48a3-ab2f-38c9a065d843 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:37.351727 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f776bb26-2c40-48a3-ab2f-38c9a065d843 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:37.352958 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f776bb26-2c40-48a3-ab2f-38c9a065d843 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:37.361701 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell1:SELECT=100 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:33:37.439793 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-f776bb26-2c40-48a3-ab2f-38c9a065d843 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:37.448028 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-f776bb26-2c40-48a3-ab2f-38c9a065d843 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1" status: 200 len: 1242 microversion: 2.1 time: 0.111028 Jun 14 18:33:37.448832 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 412/846] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:37 2022] GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1 => generated 1242 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:37.646713 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-679a6ace-fb41-4919-a14f-2f3b888ec641 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:37.647816 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-679a6ace-fb41-4919-a14f-2f3b888ec641 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:37.655901 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-679a6ace-fb41-4919-a14f-2f3b888ec641 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:37.656885 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-679a6ace-fb41-4919-a14f-2f3b888ec641 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:37.663219 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-679a6ace-fb41-4919-a14f-2f3b888ec641 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:37.663219 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-679a6ace-fb41-4919-a14f-2f3b888ec641 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:37.813100 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-679a6ace-fb41-4919-a14f-2f3b888ec641 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:37.815521 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:33:37.822257 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-679a6ace-fb41-4919-a14f-2f3b888ec641 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:37.824862 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-679a6ace-fb41-4919-a14f-2f3b888ec641 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:37.825084 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-679a6ace-fb41-4919-a14f-2f3b888ec641 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1732 microversion: 2.20 time: 0.182285 Jun 14 18:33:37.826205 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 435/847] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:33:37 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1732 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:33:38.225841 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-7de9644c-6705-449f-ad44-e36dd6ac5991 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:38.227301 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-7de9644c-6705-449f-ad44-e36dd6ac5991 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:38.235244 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7de9644c-6705-449f-ad44-e36dd6ac5991 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:38.235953 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7de9644c-6705-449f-ad44-e36dd6ac5991 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:38.237157 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7de9644c-6705-449f-ad44-e36dd6ac5991 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:38.237995 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7de9644c-6705-449f-ad44-e36dd6ac5991 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:38.240602 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-933c08b6-e5c8-4025-a7c7-d57b0303cd96 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:38.241144 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-933c08b6-e5c8-4025-a7c7-d57b0303cd96 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 41923641-5855-4385-8905-cc7dc5a46714] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:38.251339 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-933c08b6-e5c8-4025-a7c7-d57b0303cd96 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:38.251816 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-933c08b6-e5c8-4025-a7c7-d57b0303cd96 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:38.252607 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-933c08b6-e5c8-4025-a7c7-d57b0303cd96 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:38.253066 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-933c08b6-e5c8-4025-a7c7-d57b0303cd96 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:38.289698 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.wsgi [None req-933c08b6-e5c8-4025-a7c7-d57b0303cd96 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] HTTP exception thrown: Instance 41923641-5855-4385-8905-cc7dc5a46714 could not be found. Jun 14 18:33:38.292143 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-933c08b6-e5c8-4025-a7c7-d57b0303cd96 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Request method failure captured: Jun 14 18:33:38.292143 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: request: GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714 HTTP/1.1 Jun 14 18:33:38.292143 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept: application/json Jun 14 18:33:38.292143 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept-Encoding: identity Jun 14 18:33:38.292143 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Connection: close Jun 14 18:33:38.292143 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Length: 0 Jun 14 18:33:38.292143 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Type: application/json Jun 14 18:33:38.292143 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Host: 10.222.0.78 Jun 14 18:33:38.292143 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Openstack-System-Scope: None Jun 14 18:33:38.292143 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: User-Agent: python-urllib3/1.26.9 Jun 14 18:33:38.292143 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Auth-Token: gAAAAABiqNMP73XxprlGzNGbl2RRuxWxEeCnCyKOJesfEu2WL6zaFGYBG9DdxnVa9hDwyFtLBWjvTOBXMs2p5ZW_MV0Ak23jnUYR_d8O-hYGniwqFYgb3f35NWBTKNyIJC_YvLU72CIFRGkaxVcO159IMBIja5NUJPoz16EB4IP7ThRSyLD9mFA Jun 14 18:33:38.292143 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Id: None Jun 14 18:33:38.292143 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Name: None Jun 14 18:33:38.292143 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Identity-Status: Confirmed Jun 14 18:33:38.292143 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Is-Admin-Project: True Jun 14 18:33:38.292143 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Id: default Jun 14 18:33:38.292143 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Name: Default Jun 14 18:33:38.292143 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Id: e2f771a602054b349adae092a9d3ed24 Jun 14 18:33:38.292143 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Name: tempest-AttachVolumeTestJSON-1453686410 Jun 14 18:33:38.292143 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Role: reader,member Jun 14 18:33:38.292143 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Roles: reader,member Jun 14 18:33:38.293502 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e2f771a602054b349adae092a9d3ed24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e2f771a602054b349adae092a9d3ed24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e2f771a602054b349adae092a9d3ed24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e2f771a602054b349adae092a9d3ed24"}]}] Jun 14 18:33:38.293502 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant: tempest-AttachVolumeTestJSON-1453686410 Jun 14 18:33:38.293502 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Id: e2f771a602054b349adae092a9d3ed24 Jun 14 18:33:38.293502 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1453686410 Jun 14 18:33:38.293502 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User: tempest-AttachVolumeTestJSON-1453686410-project Jun 14 18:33:38.293502 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Id: default Jun 14 18:33:38.293502 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Name: Default Jun 14 18:33:38.293502 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Id: 922fd1f30c7647fdb19f8f67a39223cc Jun 14 18:33:38.293502 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Name: tempest-AttachVolumeTestJSON-1453686410-project Jun 14 18:33:38.293502 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: method: > Jun 14 18:33:38.293502 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: exception: Instance 41923641-5855-4385-8905-cc7dc5a46714 could not be found. Jun 14 18:33:38.293502 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: action_args: {'id': '41923641-5855-4385-8905-cc7dc5a46714'} Jun 14 18:33:38.297386 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:33:38.297386 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:33:38.297386 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:33:38.297386 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:33:38.297386 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:33:38.297386 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:33:38.297386 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:33:38.297386 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:33:38.297386 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:33:38.297386 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:33:38.297386 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41923641-5855-4385-8905-cc7dc5a46714 could not be found. Jun 14 18:33:38.297386 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:33:38.297386 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:33:38.297386 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:33:38.297386 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:33:38.297386 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:33:38.297386 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:33:38.297386 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:33:38.297386 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:33:38.297386 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:33:38.299150 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:33:38.299150 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:33:38.299150 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:33:38.299150 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:33:38.299150 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:33:38.299150 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:33:38.299150 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:33:38.299150 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41923641-5855-4385-8905-cc7dc5a46714 could not be found. Jun 14 18:33:38.299150 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:33:38.299150 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:33:38.299150 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:33:38.299150 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:33:38.299150 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:33:38.299150 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:33:38.299150 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:33:38.299150 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:33:38.299150 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41923641-5855-4385-8905-cc7dc5a46714 could not be found. Jun 14 18:33:38.299150 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:33:38.300676 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-933c08b6-e5c8-4025-a7c7-d57b0303cd96 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Returning 404 to user: Instance 41923641-5855-4385-8905-cc7dc5a46714 could not be found. {{(pid=118624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:33:38.300676 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-933c08b6-e5c8-4025-a7c7-d57b0303cd96 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714" status: 404 len: 111 microversion: 2.1 time: 0.059825 Jun 14 18:33:38.306004 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 436/848] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:38 2022] GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 14 18:33:38.316112 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-d234f282-eb43-49d3-966b-3e04ab17f74c tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '.version_select at 0x7efe704674c0>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:38.439605 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-7de9644c-6705-449f-ad44-e36dd6ac5991 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:38.450327 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-d234f282-eb43-49d3-966b-3e04ab17f74c tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1046940498" status: 202 len: 0 microversion: 2.1 time: 0.128742 Jun 14 18:33:38.450327 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 437/849] 10.222.0.78 () {58 vars in 1220 bytes} [Tue Jun 14 18:33:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1046940498 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:33:38.452737 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-7de9644c-6705-449f-ad44-e36dd6ac5991 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1576 microversion: 2.1 time: 0.231059 Jun 14 18:33:38.454357 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 413/850] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:38 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1576 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:38.469486 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-52d198a8-9a84-4572-ad52-8f29f5b7a047 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:38.470314 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-52d198a8-9a84-4572-ad52-8f29f5b7a047 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:38.500828 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-52d198a8-9a84-4572-ad52-8f29f5b7a047 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:38.501947 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-52d198a8-9a84-4572-ad52-8f29f5b7a047 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:38.503225 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-52d198a8-9a84-4572-ad52-8f29f5b7a047 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:38.510474 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-52d198a8-9a84-4572-ad52-8f29f5b7a047 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:38.639989 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-52d198a8-9a84-4572-ad52-8f29f5b7a047 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:38.648628 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-52d198a8-9a84-4572-ad52-8f29f5b7a047 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1" status: 200 len: 1290 microversion: 2.1 time: 0.184860 Jun 14 18:33:38.649286 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 438/851] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:38 2022] GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1 => generated 1290 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:38.845620 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-d1de9c24-a887-43f6-9450-71835f33ba9b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:38.851905 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-d1de9c24-a887-43f6-9450-71835f33ba9b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:38.859751 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d1de9c24-a887-43f6-9450-71835f33ba9b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:38.860200 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d1de9c24-a887-43f6-9450-71835f33ba9b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:38.860975 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d1de9c24-a887-43f6-9450-71835f33ba9b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:38.861409 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d1de9c24-a887-43f6-9450-71835f33ba9b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:39.097904 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-d1de9c24-a887-43f6-9450-71835f33ba9b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:39.115536 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-d1de9c24-a887-43f6-9450-71835f33ba9b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:39.119309 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-d1de9c24-a887-43f6-9450-71835f33ba9b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:39.120711 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-d1de9c24-a887-43f6-9450-71835f33ba9b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1732 microversion: 2.20 time: 0.280399 Jun 14 18:33:39.122290 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 414/852] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:33:38 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1732 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:33:39.491013 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-e4839378-d35e-4750-9a97-d3fdef126848 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:39.491753 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-e4839378-d35e-4750-9a97-d3fdef126848 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:39.508834 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e4839378-d35e-4750-9a97-d3fdef126848 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:39.509880 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e4839378-d35e-4750-9a97-d3fdef126848 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:39.515418 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e4839378-d35e-4750-9a97-d3fdef126848 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:39.515974 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e4839378-d35e-4750-9a97-d3fdef126848 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:39.665962 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-d29035b3-8ede-46ca-a192-b262db77c91e tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:39.666676 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-d29035b3-8ede-46ca-a192-b262db77c91e tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:39.678883 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d29035b3-8ede-46ca-a192-b262db77c91e tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:39.680105 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d29035b3-8ede-46ca-a192-b262db77c91e tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:39.684838 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d29035b3-8ede-46ca-a192-b262db77c91e tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:39.685743 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d29035b3-8ede-46ca-a192-b262db77c91e tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:39.807899 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-d29035b3-8ede-46ca-a192-b262db77c91e tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:39.816692 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-d29035b3-8ede-46ca-a192-b262db77c91e tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1" status: 200 len: 1290 microversion: 2.1 time: 0.155463 Jun 14 18:33:39.817709 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 415/853] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:39 2022] GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1 => generated 1290 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:39.822903 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-59caa278-0fe8-4fce-beb1-9990fa107ac2 req-d82f03e6-8d7c-49aa-9f9c-cffadc63bfc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "750a5111-2788-46b6-aa18-57f7c1019d64", "name": "network-vif-plugged", "status": "completed", "tag": "4fa1bac8-6b6d-4a62-afca-3aed68487621"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:33:39.833643 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-59caa278-0fe8-4fce-beb1-9990fa107ac2 req-d82f03e6-8d7c-49aa-9f9c-cffadc63bfc0 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:39.834337 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-59caa278-0fe8-4fce-beb1-9990fa107ac2 req-d82f03e6-8d7c-49aa-9f9c-cffadc63bfc0 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:39.840937 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-e4839378-d35e-4750-9a97-d3fdef126848 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:39.848797 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-59caa278-0fe8-4fce-beb1-9990fa107ac2 req-d82f03e6-8d7c-49aa-9f9c-cffadc63bfc0 service nova] Creating event network-vif-plugged:4fa1bac8-6b6d-4a62-afca-3aed68487621 for instance 750a5111-2788-46b6-aa18-57f7c1019d64 on hv-cinder-84456 Jun 14 18:33:39.854806 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-59caa278-0fe8-4fce-beb1-9990fa107ac2 req-d82f03e6-8d7c-49aa-9f9c-cffadc63bfc0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035492 Jun 14 18:33:39.855786 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 416/854] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:33:39.861317 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-e4839378-d35e-4750-9a97-d3fdef126848 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1576 microversion: 2.1 time: 0.390613 Jun 14 18:33:39.863187 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 439/855] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:39 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1576 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:33:40.141394 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-10b6e8b6-71dc-419a-9e2f-af779aec1c31 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:40.142581 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-10b6e8b6-71dc-419a-9e2f-af779aec1c31 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:40.150032 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-10b6e8b6-71dc-419a-9e2f-af779aec1c31 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:40.150737 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-10b6e8b6-71dc-419a-9e2f-af779aec1c31 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:40.151787 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-10b6e8b6-71dc-419a-9e2f-af779aec1c31 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:40.152542 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-10b6e8b6-71dc-419a-9e2f-af779aec1c31 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:40.347887 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-10b6e8b6-71dc-419a-9e2f-af779aec1c31 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:40.362458 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-10b6e8b6-71dc-419a-9e2f-af779aec1c31 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:40.364177 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-10b6e8b6-71dc-419a-9e2f-af779aec1c31 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:40.365505 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-10b6e8b6-71dc-419a-9e2f-af779aec1c31 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1732 microversion: 2.20 time: 0.230350 Jun 14 18:33:40.366182 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 417/856] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:33:40 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1732 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:33:40.841981 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-0ed97bc1-eb3c-4e1b-ab3b-35475bb6a445 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:40.842932 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-0ed97bc1-eb3c-4e1b-ab3b-35475bb6a445 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:40.850927 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-0ed97bc1-eb3c-4e1b-ab3b-35475bb6a445 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:40.851876 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-0ed97bc1-eb3c-4e1b-ab3b-35475bb6a445 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:40.852775 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-0ed97bc1-eb3c-4e1b-ab3b-35475bb6a445 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:40.853602 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-0ed97bc1-eb3c-4e1b-ab3b-35475bb6a445 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:40.880717 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-2c96ec96-2002-4a10-a4e4-12a00740c0f7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:40.881659 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-2c96ec96-2002-4a10-a4e4-12a00740c0f7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:40.898811 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2c96ec96-2002-4a10-a4e4-12a00740c0f7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:40.899334 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2c96ec96-2002-4a10-a4e4-12a00740c0f7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:40.900106 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2c96ec96-2002-4a10-a4e4-12a00740c0f7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:40.900535 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2c96ec96-2002-4a10-a4e4-12a00740c0f7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:40.941612 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-0ed97bc1-eb3c-4e1b-ab3b-35475bb6a445 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:40.955252 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-0ed97bc1-eb3c-4e1b-ab3b-35475bb6a445 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1" status: 200 len: 1290 microversion: 2.1 time: 0.116761 Jun 14 18:33:40.965835 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 440/857] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:40 2022] GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1 => generated 1290 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:41.123581 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-2c96ec96-2002-4a10-a4e4-12a00740c0f7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:41.132983 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-2c96ec96-2002-4a10-a4e4-12a00740c0f7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1576 microversion: 2.1 time: 0.256546 Jun 14 18:33:41.133738 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 418/858] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:40 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1576 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:41.384432 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-4a634d66-bf77-48fb-a360-837a1f21189d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:41.384928 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-4a634d66-bf77-48fb-a360-837a1f21189d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:41.394054 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4a634d66-bf77-48fb-a360-837a1f21189d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:41.394522 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4a634d66-bf77-48fb-a360-837a1f21189d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:41.395319 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4a634d66-bf77-48fb-a360-837a1f21189d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:41.395763 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4a634d66-bf77-48fb-a360-837a1f21189d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:41.570858 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-4a634d66-bf77-48fb-a360-837a1f21189d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:41.590475 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-4a634d66-bf77-48fb-a360-837a1f21189d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:41.593324 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-4a634d66-bf77-48fb-a360-837a1f21189d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:41.595167 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-4a634d66-bf77-48fb-a360-837a1f21189d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1732 microversion: 2.20 time: 0.214825 Jun 14 18:33:41.596861 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 441/859] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:33:41 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1732 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:33:41.973795 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-0b264b7b-2a37-46d4-9a02-d7f8c6c29889 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:41.974496 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-0b264b7b-2a37-46d4-9a02-d7f8c6c29889 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:41.981346 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0b264b7b-2a37-46d4-9a02-d7f8c6c29889 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:41.982478 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0b264b7b-2a37-46d4-9a02-d7f8c6c29889 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:41.983228 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0b264b7b-2a37-46d4-9a02-d7f8c6c29889 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:41.983859 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0b264b7b-2a37-46d4-9a02-d7f8c6c29889 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:42.056550 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-0b264b7b-2a37-46d4-9a02-d7f8c6c29889 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:42.065064 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-0b264b7b-2a37-46d4-9a02-d7f8c6c29889 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1" status: 200 len: 1290 microversion: 2.1 time: 0.095360 Jun 14 18:33:42.068679 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 419/860] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:41 2022] GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1 => generated 1290 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:42.122083 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-97636366-4c44-43b9-b9ef-f4d6fd044524 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:42.122925 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-97636366-4c44-43b9-b9ef-f4d6fd044524 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 41923641-5855-4385-8905-cc7dc5a46714] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:42.130350 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-97636366-4c44-43b9-b9ef-f4d6fd044524 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:42.130807 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-97636366-4c44-43b9-b9ef-f4d6fd044524 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:42.131617 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-97636366-4c44-43b9-b9ef-f4d6fd044524 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:42.132246 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-97636366-4c44-43b9-b9ef-f4d6fd044524 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:42.150938 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.wsgi [None req-97636366-4c44-43b9-b9ef-f4d6fd044524 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] HTTP exception thrown: Instance 41923641-5855-4385-8905-cc7dc5a46714 could not be found. Jun 14 18:33:42.152799 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-97636366-4c44-43b9-b9ef-f4d6fd044524 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Request method failure captured: Jun 14 18:33:42.152799 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: request: DELETE /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714 HTTP/1.1 Jun 14 18:33:42.152799 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept: application/json Jun 14 18:33:42.152799 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept-Encoding: identity Jun 14 18:33:42.152799 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Connection: close Jun 14 18:33:42.152799 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Length: 0 Jun 14 18:33:42.152799 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Type: application/json Jun 14 18:33:42.152799 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Host: 10.222.0.78 Jun 14 18:33:42.152799 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Openstack-System-Scope: None Jun 14 18:33:42.152799 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: User-Agent: python-urllib3/1.26.9 Jun 14 18:33:42.152799 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Auth-Token: gAAAAABiqNMP73XxprlGzNGbl2RRuxWxEeCnCyKOJesfEu2WL6zaFGYBG9DdxnVa9hDwyFtLBWjvTOBXMs2p5ZW_MV0Ak23jnUYR_d8O-hYGniwqFYgb3f35NWBTKNyIJC_YvLU72CIFRGkaxVcO159IMBIja5NUJPoz16EB4IP7ThRSyLD9mFA Jun 14 18:33:42.152799 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Id: None Jun 14 18:33:42.152799 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Name: None Jun 14 18:33:42.152799 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Identity-Status: Confirmed Jun 14 18:33:42.152799 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Is-Admin-Project: True Jun 14 18:33:42.152799 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Id: default Jun 14 18:33:42.152799 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Name: Default Jun 14 18:33:42.152799 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Id: e2f771a602054b349adae092a9d3ed24 Jun 14 18:33:42.152799 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Name: tempest-AttachVolumeTestJSON-1453686410 Jun 14 18:33:42.152799 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Role: reader,member Jun 14 18:33:42.152799 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Roles: reader,member Jun 14 18:33:42.157048 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e2f771a602054b349adae092a9d3ed24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e2f771a602054b349adae092a9d3ed24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e2f771a602054b349adae092a9d3ed24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e2f771a602054b349adae092a9d3ed24"}]}] Jun 14 18:33:42.157048 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant: tempest-AttachVolumeTestJSON-1453686410 Jun 14 18:33:42.157048 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Id: e2f771a602054b349adae092a9d3ed24 Jun 14 18:33:42.157048 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1453686410 Jun 14 18:33:42.157048 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User: tempest-AttachVolumeTestJSON-1453686410-project Jun 14 18:33:42.157048 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Id: default Jun 14 18:33:42.157048 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Name: Default Jun 14 18:33:42.157048 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Id: 922fd1f30c7647fdb19f8f67a39223cc Jun 14 18:33:42.157048 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Name: tempest-AttachVolumeTestJSON-1453686410-project Jun 14 18:33:42.157048 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: method: > Jun 14 18:33:42.157048 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: exception: Instance 41923641-5855-4385-8905-cc7dc5a46714 could not be found. Jun 14 18:33:42.157048 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: action_args: {'id': '41923641-5855-4385-8905-cc7dc5a46714'} Jun 14 18:33:42.157858 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:33:42.157858 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:33:42.157858 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:33:42.157858 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:33:42.157858 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:33:42.157858 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:33:42.157858 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:33:42.157858 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:33:42.157858 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:33:42.157858 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:33:42.157858 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41923641-5855-4385-8905-cc7dc5a46714 could not be found. Jun 14 18:33:42.157858 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:33:42.157858 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:33:42.157858 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:33:42.157858 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:33:42.157858 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:33:42.157858 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:33:42.157858 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:33:42.157858 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:33:42.157858 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:33:42.159024 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:33:42.159024 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 14 18:33:42.159024 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 14 18:33:42.159024 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 14 18:33:42.159024 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 14 18:33:42.159024 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:33:42.159024 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:33:42.159024 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:33:42.159024 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:33:42.159024 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41923641-5855-4385-8905-cc7dc5a46714 could not be found. Jun 14 18:33:42.159024 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:33:42.159024 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:33:42.159024 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:33:42.159024 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:33:42.159024 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:33:42.159024 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:33:42.159024 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:33:42.159024 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:33:42.159024 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41923641-5855-4385-8905-cc7dc5a46714 could not be found. Jun 14 18:33:42.159024 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:33:42.160244 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-97636366-4c44-43b9-b9ef-f4d6fd044524 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Returning 404 to user: Instance 41923641-5855-4385-8905-cc7dc5a46714 could not be found. {{(pid=118624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:33:42.160321 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-5cd5d13e-e4bd-432f-a25d-354c5bc3f054 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:42.161545 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-5cd5d13e-e4bd-432f-a25d-354c5bc3f054 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:42.162308 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-97636366-4c44-43b9-b9ef-f4d6fd044524 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "DELETE /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714" status: 404 len: 111 microversion: 2.1 time: 0.044080 Jun 14 18:33:42.163423 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 442/861] 10.222.0.78 () {58 vars in 1238 bytes} [Tue Jun 14 18:33:42 2022] DELETE /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:33:42.177406 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5cd5d13e-e4bd-432f-a25d-354c5bc3f054 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:42.182884 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5cd5d13e-e4bd-432f-a25d-354c5bc3f054 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:42.183029 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-605f09d0-f051-4ac1-aeb8-16db6cab0ef9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:42.183119 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5cd5d13e-e4bd-432f-a25d-354c5bc3f054 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:42.183213 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-605f09d0-f051-4ac1-aeb8-16db6cab0ef9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 41923641-5855-4385-8905-cc7dc5a46714] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:42.183383 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-5cd5d13e-e4bd-432f-a25d-354c5bc3f054 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:42.190317 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-605f09d0-f051-4ac1-aeb8-16db6cab0ef9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:42.191114 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-605f09d0-f051-4ac1-aeb8-16db6cab0ef9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:42.192403 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-605f09d0-f051-4ac1-aeb8-16db6cab0ef9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:42.193068 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-605f09d0-f051-4ac1-aeb8-16db6cab0ef9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:42.235599 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.wsgi [None req-605f09d0-f051-4ac1-aeb8-16db6cab0ef9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] HTTP exception thrown: Instance 41923641-5855-4385-8905-cc7dc5a46714 could not be found. Jun 14 18:33:42.239440 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-605f09d0-f051-4ac1-aeb8-16db6cab0ef9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Request method failure captured: Jun 14 18:33:42.239440 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: request: GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714 HTTP/1.1 Jun 14 18:33:42.239440 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept: application/json Jun 14 18:33:42.239440 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept-Encoding: identity Jun 14 18:33:42.239440 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Connection: close Jun 14 18:33:42.239440 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Length: 0 Jun 14 18:33:42.239440 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Type: application/json Jun 14 18:33:42.239440 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Host: 10.222.0.78 Jun 14 18:33:42.239440 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Openstack-System-Scope: None Jun 14 18:33:42.239440 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: User-Agent: python-urllib3/1.26.9 Jun 14 18:33:42.239440 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Auth-Token: gAAAAABiqNMP73XxprlGzNGbl2RRuxWxEeCnCyKOJesfEu2WL6zaFGYBG9DdxnVa9hDwyFtLBWjvTOBXMs2p5ZW_MV0Ak23jnUYR_d8O-hYGniwqFYgb3f35NWBTKNyIJC_YvLU72CIFRGkaxVcO159IMBIja5NUJPoz16EB4IP7ThRSyLD9mFA Jun 14 18:33:42.239440 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Id: None Jun 14 18:33:42.239440 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Name: None Jun 14 18:33:42.239440 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Identity-Status: Confirmed Jun 14 18:33:42.239440 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Is-Admin-Project: True Jun 14 18:33:42.239440 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Id: default Jun 14 18:33:42.239440 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Name: Default Jun 14 18:33:42.239440 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Id: e2f771a602054b349adae092a9d3ed24 Jun 14 18:33:42.239440 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Name: tempest-AttachVolumeTestJSON-1453686410 Jun 14 18:33:42.239440 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Role: reader,member Jun 14 18:33:42.239440 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Roles: reader,member Jun 14 18:33:42.249072 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e2f771a602054b349adae092a9d3ed24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e2f771a602054b349adae092a9d3ed24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e2f771a602054b349adae092a9d3ed24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e2f771a602054b349adae092a9d3ed24"}]}] Jun 14 18:33:42.249072 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant: tempest-AttachVolumeTestJSON-1453686410 Jun 14 18:33:42.249072 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Id: e2f771a602054b349adae092a9d3ed24 Jun 14 18:33:42.249072 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1453686410 Jun 14 18:33:42.249072 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User: tempest-AttachVolumeTestJSON-1453686410-project Jun 14 18:33:42.249072 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Id: default Jun 14 18:33:42.249072 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Name: Default Jun 14 18:33:42.249072 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Id: 922fd1f30c7647fdb19f8f67a39223cc Jun 14 18:33:42.249072 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Name: tempest-AttachVolumeTestJSON-1453686410-project Jun 14 18:33:42.249072 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: method: > Jun 14 18:33:42.249072 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: exception: Instance 41923641-5855-4385-8905-cc7dc5a46714 could not be found. Jun 14 18:33:42.249072 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: action_args: {'id': '41923641-5855-4385-8905-cc7dc5a46714'} Jun 14 18:33:42.250712 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:33:42.250712 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:33:42.250712 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:33:42.250712 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:33:42.250712 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:33:42.250712 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:33:42.250712 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:33:42.250712 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:33:42.250712 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:33:42.250712 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:33:42.250712 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41923641-5855-4385-8905-cc7dc5a46714 could not be found. Jun 14 18:33:42.250712 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:33:42.250712 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:33:42.250712 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:33:42.250712 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:33:42.250712 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:33:42.250712 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:33:42.250712 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:33:42.250712 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:33:42.250712 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:33:42.253495 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:33:42.253495 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:33:42.253495 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:33:42.253495 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:33:42.253495 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:33:42.253495 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:33:42.253495 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:33:42.253495 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41923641-5855-4385-8905-cc7dc5a46714 could not be found. Jun 14 18:33:42.253495 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:33:42.253495 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:33:42.253495 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:33:42.253495 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:33:42.253495 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:33:42.253495 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:33:42.253495 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:33:42.253495 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:33:42.253495 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41923641-5855-4385-8905-cc7dc5a46714 could not be found. Jun 14 18:33:42.253495 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:33:42.259607 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-605f09d0-f051-4ac1-aeb8-16db6cab0ef9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Returning 404 to user: Instance 41923641-5855-4385-8905-cc7dc5a46714 could not be found. {{(pid=118624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:33:42.259607 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-605f09d0-f051-4ac1-aeb8-16db6cab0ef9 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714" status: 404 len: 111 microversion: 2.1 time: 0.073769 Jun 14 18:33:42.259607 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 443/862] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:42 2022] GET /compute/v2.1/servers/41923641-5855-4385-8905-cc7dc5a46714 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 14 18:33:42.436520 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-5cd5d13e-e4bd-432f-a25d-354c5bc3f054 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:42.445435 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-5cd5d13e-e4bd-432f-a25d-354c5bc3f054 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1576 microversion: 2.1 time: 0.298370 Jun 14 18:33:42.446135 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 420/863] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:42 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1576 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:33:42.627392 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-b781bf04-c246-4c97-a949-b6f8ff398421 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:42.629655 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-b781bf04-c246-4c97-a949-b6f8ff398421 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:42.646502 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b781bf04-c246-4c97-a949-b6f8ff398421 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:42.648885 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b781bf04-c246-4c97-a949-b6f8ff398421 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:42.650887 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b781bf04-c246-4c97-a949-b6f8ff398421 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:42.652347 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b781bf04-c246-4c97-a949-b6f8ff398421 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:42.878581 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-b781bf04-c246-4c97-a949-b6f8ff398421 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:42.888572 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-b781bf04-c246-4c97-a949-b6f8ff398421 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:42.890692 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-b781bf04-c246-4c97-a949-b6f8ff398421 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:42.892220 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-b781bf04-c246-4c97-a949-b6f8ff398421 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1732 microversion: 2.20 time: 0.273119 Jun 14 18:33:42.892861 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 444/864] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:33:42 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1732 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:33:43.085531 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-11cbe184-4a92-4e42-bb27-982c74314427 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:43.086784 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-11cbe184-4a92-4e42-bb27-982c74314427 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:43.093977 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-11cbe184-4a92-4e42-bb27-982c74314427 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:43.094797 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-11cbe184-4a92-4e42-bb27-982c74314427 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:43.095596 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-11cbe184-4a92-4e42-bb27-982c74314427 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:43.096034 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-11cbe184-4a92-4e42-bb27-982c74314427 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:43.337942 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-11cbe184-4a92-4e42-bb27-982c74314427 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:43.348159 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-11cbe184-4a92-4e42-bb27-982c74314427 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1" status: 200 len: 1290 microversion: 2.1 time: 0.266576 Jun 14 18:33:43.358358 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 421/865] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:43 2022] GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1 => generated 1290 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:43.466001 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-3e569fcc-8be3-4b1a-8849-5d44c5e21a02 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:43.468750 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-3e569fcc-8be3-4b1a-8849-5d44c5e21a02 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:43.488152 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3e569fcc-8be3-4b1a-8849-5d44c5e21a02 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:43.489113 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3e569fcc-8be3-4b1a-8849-5d44c5e21a02 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:43.490168 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3e569fcc-8be3-4b1a-8849-5d44c5e21a02 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:43.491125 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3e569fcc-8be3-4b1a-8849-5d44c5e21a02 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:43.596993 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-62fddc37-c700-4aab-b411-4506376e1b51 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:43.597709 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-62fddc37-c700-4aab-b411-4506376e1b51 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:43.604907 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-62fddc37-c700-4aab-b411-4506376e1b51 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:43.605897 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-62fddc37-c700-4aab-b411-4506376e1b51 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:43.608551 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-62fddc37-c700-4aab-b411-4506376e1b51 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:43.609607 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-62fddc37-c700-4aab-b411-4506376e1b51 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:43.631305 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.wsgi [None req-62fddc37-c700-4aab-b411-4506376e1b51 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] HTTP exception thrown: Instance 90a63d77-87d7-4616-af3d-fe6cb12e93fe could not be found. Jun 14 18:33:43.634447 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-62fddc37-c700-4aab-b411-4506376e1b51 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Request method failure captured: Jun 14 18:33:43.634447 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: request: DELETE /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe HTTP/1.1 Jun 14 18:33:43.634447 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept: application/json Jun 14 18:33:43.634447 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept-Encoding: identity Jun 14 18:33:43.634447 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Connection: close Jun 14 18:33:43.634447 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Length: 0 Jun 14 18:33:43.634447 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Type: application/json Jun 14 18:33:43.634447 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Host: 10.222.0.78 Jun 14 18:33:43.634447 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Openstack-System-Scope: None Jun 14 18:33:43.634447 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: User-Agent: python-urllib3/1.26.9 Jun 14 18:33:43.634447 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Auth-Token: gAAAAABiqNMP73XxprlGzNGbl2RRuxWxEeCnCyKOJesfEu2WL6zaFGYBG9DdxnVa9hDwyFtLBWjvTOBXMs2p5ZW_MV0Ak23jnUYR_d8O-hYGniwqFYgb3f35NWBTKNyIJC_YvLU72CIFRGkaxVcO159IMBIja5NUJPoz16EB4IP7ThRSyLD9mFA Jun 14 18:33:43.634447 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Id: None Jun 14 18:33:43.634447 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Name: None Jun 14 18:33:43.634447 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Identity-Status: Confirmed Jun 14 18:33:43.634447 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Is-Admin-Project: True Jun 14 18:33:43.634447 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Id: default Jun 14 18:33:43.634447 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Name: Default Jun 14 18:33:43.634447 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Id: e2f771a602054b349adae092a9d3ed24 Jun 14 18:33:43.634447 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Name: tempest-AttachVolumeTestJSON-1453686410 Jun 14 18:33:43.634447 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Role: reader,member Jun 14 18:33:43.634447 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Roles: reader,member Jun 14 18:33:43.635807 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e2f771a602054b349adae092a9d3ed24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e2f771a602054b349adae092a9d3ed24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e2f771a602054b349adae092a9d3ed24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e2f771a602054b349adae092a9d3ed24"}]}] Jun 14 18:33:43.635807 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant: tempest-AttachVolumeTestJSON-1453686410 Jun 14 18:33:43.635807 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Id: e2f771a602054b349adae092a9d3ed24 Jun 14 18:33:43.635807 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1453686410 Jun 14 18:33:43.635807 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User: tempest-AttachVolumeTestJSON-1453686410-project Jun 14 18:33:43.635807 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Id: default Jun 14 18:33:43.635807 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Name: Default Jun 14 18:33:43.635807 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Id: 922fd1f30c7647fdb19f8f67a39223cc Jun 14 18:33:43.635807 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Name: tempest-AttachVolumeTestJSON-1453686410-project Jun 14 18:33:43.635807 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: method: > Jun 14 18:33:43.635807 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: exception: Instance 90a63d77-87d7-4616-af3d-fe6cb12e93fe could not be found. Jun 14 18:33:43.635807 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: action_args: {'id': '90a63d77-87d7-4616-af3d-fe6cb12e93fe'} Jun 14 18:33:43.636599 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:33:43.636599 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:33:43.636599 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:33:43.636599 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:33:43.636599 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:33:43.636599 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:33:43.636599 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:33:43.636599 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:33:43.636599 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:33:43.636599 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:33:43.636599 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90a63d77-87d7-4616-af3d-fe6cb12e93fe could not be found. Jun 14 18:33:43.636599 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:33:43.636599 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:33:43.636599 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:33:43.636599 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:33:43.636599 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:33:43.636599 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:33:43.636599 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:33:43.636599 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:33:43.636599 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:33:43.637930 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:33:43.637930 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 14 18:33:43.637930 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 14 18:33:43.637930 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 14 18:33:43.637930 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 14 18:33:43.637930 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:33:43.637930 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:33:43.637930 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:33:43.637930 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:33:43.637930 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90a63d77-87d7-4616-af3d-fe6cb12e93fe could not be found. Jun 14 18:33:43.637930 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:33:43.637930 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:33:43.637930 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:33:43.637930 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:33:43.637930 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:33:43.637930 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:33:43.637930 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:33:43.637930 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:33:43.637930 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90a63d77-87d7-4616-af3d-fe6cb12e93fe could not be found. Jun 14 18:33:43.637930 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:33:43.641364 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-62fddc37-c700-4aab-b411-4506376e1b51 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Returning 404 to user: Instance 90a63d77-87d7-4616-af3d-fe6cb12e93fe could not be found. {{(pid=118623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:33:43.643215 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-62fddc37-c700-4aab-b411-4506376e1b51 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "DELETE /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 404 len: 111 microversion: 2.1 time: 0.050464 Jun 14 18:33:43.648735 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 422/866] 10.222.0.78 () {58 vars in 1238 bytes} [Tue Jun 14 18:33:43 2022] DELETE /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:33:43.660146 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-3b00bada-649b-4c4f-a667-41d86177c8b3 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:43.661398 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-3b00bada-649b-4c4f-a667-41d86177c8b3 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] [instance: 90a63d77-87d7-4616-af3d-fe6cb12e93fe] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:43.671042 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3b00bada-649b-4c4f-a667-41d86177c8b3 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:43.671323 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-3e569fcc-8be3-4b1a-8849-5d44c5e21a02 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:43.672813 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3b00bada-649b-4c4f-a667-41d86177c8b3 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:43.675786 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3b00bada-649b-4c4f-a667-41d86177c8b3 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:43.676533 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3b00bada-649b-4c4f-a667-41d86177c8b3 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:43.682410 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-3e569fcc-8be3-4b1a-8849-5d44c5e21a02 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1576 microversion: 2.1 time: 0.222184 Jun 14 18:33:43.683045 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 445/867] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:43 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1576 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:43.703985 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.wsgi [None req-3b00bada-649b-4c4f-a667-41d86177c8b3 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] HTTP exception thrown: Instance 90a63d77-87d7-4616-af3d-fe6cb12e93fe could not be found. Jun 14 18:33:43.705935 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-3b00bada-649b-4c4f-a667-41d86177c8b3 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Request method failure captured: Jun 14 18:33:43.705935 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: request: GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe HTTP/1.1 Jun 14 18:33:43.705935 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept: application/json Jun 14 18:33:43.705935 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept-Encoding: identity Jun 14 18:33:43.705935 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Connection: close Jun 14 18:33:43.705935 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Length: 0 Jun 14 18:33:43.705935 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Type: application/json Jun 14 18:33:43.705935 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Host: 10.222.0.78 Jun 14 18:33:43.705935 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Openstack-System-Scope: None Jun 14 18:33:43.705935 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: User-Agent: python-urllib3/1.26.9 Jun 14 18:33:43.705935 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Auth-Token: gAAAAABiqNMP73XxprlGzNGbl2RRuxWxEeCnCyKOJesfEu2WL6zaFGYBG9DdxnVa9hDwyFtLBWjvTOBXMs2p5ZW_MV0Ak23jnUYR_d8O-hYGniwqFYgb3f35NWBTKNyIJC_YvLU72CIFRGkaxVcO159IMBIja5NUJPoz16EB4IP7ThRSyLD9mFA Jun 14 18:33:43.705935 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Id: None Jun 14 18:33:43.705935 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Name: None Jun 14 18:33:43.705935 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Identity-Status: Confirmed Jun 14 18:33:43.705935 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Is-Admin-Project: True Jun 14 18:33:43.705935 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Id: default Jun 14 18:33:43.705935 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Name: Default Jun 14 18:33:43.705935 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Id: e2f771a602054b349adae092a9d3ed24 Jun 14 18:33:43.705935 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Name: tempest-AttachVolumeTestJSON-1453686410 Jun 14 18:33:43.705935 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Role: reader,member Jun 14 18:33:43.705935 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Roles: reader,member Jun 14 18:33:43.707314 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e2f771a602054b349adae092a9d3ed24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e2f771a602054b349adae092a9d3ed24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e2f771a602054b349adae092a9d3ed24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e2f771a602054b349adae092a9d3ed24"}]}] Jun 14 18:33:43.707314 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant: tempest-AttachVolumeTestJSON-1453686410 Jun 14 18:33:43.707314 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Id: e2f771a602054b349adae092a9d3ed24 Jun 14 18:33:43.707314 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1453686410 Jun 14 18:33:43.707314 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User: tempest-AttachVolumeTestJSON-1453686410-project Jun 14 18:33:43.707314 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Id: default Jun 14 18:33:43.707314 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Name: Default Jun 14 18:33:43.707314 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Id: 922fd1f30c7647fdb19f8f67a39223cc Jun 14 18:33:43.707314 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Name: tempest-AttachVolumeTestJSON-1453686410-project Jun 14 18:33:43.707314 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: method: > Jun 14 18:33:43.707314 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: exception: Instance 90a63d77-87d7-4616-af3d-fe6cb12e93fe could not be found. Jun 14 18:33:43.707314 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: action_args: {'id': '90a63d77-87d7-4616-af3d-fe6cb12e93fe'} Jun 14 18:33:43.708056 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:33:43.708056 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:33:43.708056 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:33:43.708056 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:33:43.708056 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:33:43.708056 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:33:43.708056 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:33:43.708056 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:33:43.708056 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:33:43.708056 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:33:43.708056 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90a63d77-87d7-4616-af3d-fe6cb12e93fe could not be found. Jun 14 18:33:43.708056 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:33:43.708056 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:33:43.708056 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:33:43.708056 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:33:43.708056 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:33:43.708056 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:33:43.708056 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:33:43.708056 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:33:43.708056 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:33:43.709931 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:33:43.709931 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:33:43.709931 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:33:43.709931 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:33:43.709931 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:33:43.709931 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:33:43.709931 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:33:43.709931 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90a63d77-87d7-4616-af3d-fe6cb12e93fe could not be found. Jun 14 18:33:43.709931 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:33:43.709931 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:33:43.709931 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:33:43.709931 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:33:43.709931 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:33:43.709931 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:33:43.709931 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:33:43.709931 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:33:43.709931 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90a63d77-87d7-4616-af3d-fe6cb12e93fe could not be found. Jun 14 18:33:43.709931 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:33:43.710987 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-3b00bada-649b-4c4f-a667-41d86177c8b3 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] Returning 404 to user: Instance 90a63d77-87d7-4616-af3d-fe6cb12e93fe could not be found. {{(pid=118623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:33:43.710987 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-3b00bada-649b-4c4f-a667-41d86177c8b3 tempest-AttachVolumeTestJSON-1453686410 tempest-AttachVolumeTestJSON-1453686410-project] 10.222.0.78 "GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe" status: 404 len: 111 microversion: 2.1 time: 0.057137 Jun 14 18:33:43.711930 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 423/868] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:43 2022] GET /compute/v2.1/servers/90a63d77-87d7-4616-af3d-fe6cb12e93fe => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:33:43.917945 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-6628ce1c-c921-4a93-b2bf-eea13c9d38a0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:43.922781 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-6628ce1c-c921-4a93-b2bf-eea13c9d38a0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:43.931313 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6628ce1c-c921-4a93-b2bf-eea13c9d38a0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:43.932136 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6628ce1c-c921-4a93-b2bf-eea13c9d38a0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:43.933161 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6628ce1c-c921-4a93-b2bf-eea13c9d38a0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:43.933839 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6628ce1c-c921-4a93-b2bf-eea13c9d38a0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:44.180953 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-6628ce1c-c921-4a93-b2bf-eea13c9d38a0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:44.210134 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-6628ce1c-c921-4a93-b2bf-eea13c9d38a0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:44.212161 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-6628ce1c-c921-4a93-b2bf-eea13c9d38a0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:44.213651 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-6628ce1c-c921-4a93-b2bf-eea13c9d38a0 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1732 microversion: 2.20 time: 0.305304 Jun 14 18:33:44.222015 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 446/869] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:33:43 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1732 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:33:44.366494 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-3080057a-f4c1-4441-b6a3-4260da1a5063 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:44.367159 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-3080057a-f4c1-4441-b6a3-4260da1a5063 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:44.384863 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3080057a-f4c1-4441-b6a3-4260da1a5063 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:44.385362 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3080057a-f4c1-4441-b6a3-4260da1a5063 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:44.386260 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3080057a-f4c1-4441-b6a3-4260da1a5063 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:44.386702 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3080057a-f4c1-4441-b6a3-4260da1a5063 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:44.536849 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-3080057a-f4c1-4441-b6a3-4260da1a5063 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:44.571980 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-3080057a-f4c1-4441-b6a3-4260da1a5063 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1" status: 200 len: 1290 microversion: 2.1 time: 0.197702 Jun 14 18:33:44.573212 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 424/870] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:44 2022] GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1 => generated 1290 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:44.700292 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-cb37b77d-363d-460f-9db1-900858ae0c2d tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:44.702396 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-cb37b77d-363d-460f-9db1-900858ae0c2d tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:44.715201 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-cb37b77d-363d-460f-9db1-900858ae0c2d tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:44.716605 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-cb37b77d-363d-460f-9db1-900858ae0c2d tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:44.717812 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-cb37b77d-363d-460f-9db1-900858ae0c2d tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:44.718425 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-cb37b77d-363d-460f-9db1-900858ae0c2d tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:44.948411 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-cb37b77d-363d-460f-9db1-900858ae0c2d tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:44.958419 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-cb37b77d-363d-460f-9db1-900858ae0c2d tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1576 microversion: 2.1 time: 0.261875 Jun 14 18:33:44.959758 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 447/871] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:44 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1576 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:45.233239 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-da208e65-2331-42f6-9da1-54c2cabff52d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:45.233870 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-da208e65-2331-42f6-9da1-54c2cabff52d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:45.235903 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:33:45.241324 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-da208e65-2331-42f6-9da1-54c2cabff52d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:45.241806 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-da208e65-2331-42f6-9da1-54c2cabff52d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:45.242782 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-da208e65-2331-42f6-9da1-54c2cabff52d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:45.243215 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-da208e65-2331-42f6-9da1-54c2cabff52d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:45.502321 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-da208e65-2331-42f6-9da1-54c2cabff52d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:45.519338 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-da208e65-2331-42f6-9da1-54c2cabff52d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:45.522174 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-da208e65-2331-42f6-9da1-54c2cabff52d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:45.524838 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-da208e65-2331-42f6-9da1-54c2cabff52d tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1732 microversion: 2.20 time: 0.295142 Jun 14 18:33:45.526000 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 425/872] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:33:45 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1732 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:33:45.594033 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-08bf6666-9e9b-4ab1-bf2d-9e22b6718be3 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:45.594650 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-08bf6666-9e9b-4ab1-bf2d-9e22b6718be3 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:45.596577 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:33:45.601238 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-08bf6666-9e9b-4ab1-bf2d-9e22b6718be3 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:45.601725 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-08bf6666-9e9b-4ab1-bf2d-9e22b6718be3 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:45.602495 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-08bf6666-9e9b-4ab1-bf2d-9e22b6718be3 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:45.602925 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-08bf6666-9e9b-4ab1-bf2d-9e22b6718be3 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:45.673667 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-08bf6666-9e9b-4ab1-bf2d-9e22b6718be3 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:45.681867 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-08bf6666-9e9b-4ab1-bf2d-9e22b6718be3 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1" status: 200 len: 1290 microversion: 2.1 time: 0.093849 Jun 14 18:33:45.682564 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 448/873] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:45 2022] GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1 => generated 1290 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:45.976301 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-25a602b9-d127-4f15-8ad4-2c05ee980afd tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:45.977067 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-25a602b9-d127-4f15-8ad4-2c05ee980afd tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:45.984464 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-25a602b9-d127-4f15-8ad4-2c05ee980afd tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:45.985079 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-25a602b9-d127-4f15-8ad4-2c05ee980afd tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:45.985998 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-25a602b9-d127-4f15-8ad4-2c05ee980afd tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:45.986541 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-25a602b9-d127-4f15-8ad4-2c05ee980afd tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:46.214731 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-25a602b9-d127-4f15-8ad4-2c05ee980afd tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:46.224040 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-25a602b9-d127-4f15-8ad4-2c05ee980afd tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1576 microversion: 2.1 time: 0.251597 Jun 14 18:33:46.224951 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 426/874] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:45 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1576 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:46.587787 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-64a15846-bc2e-46dc-a9ec-0f07bd9e7e73 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:46.589206 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-64a15846-bc2e-46dc-a9ec-0f07bd9e7e73 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:46.595083 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell0:SELECT=2 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:33:46.596823 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell0:SELECT=10 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:33:46.598331 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-64a15846-bc2e-46dc-a9ec-0f07bd9e7e73 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:46.598852 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-64a15846-bc2e-46dc-a9ec-0f07bd9e7e73 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:46.599631 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-64a15846-bc2e-46dc-a9ec-0f07bd9e7e73 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:46.600063 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-64a15846-bc2e-46dc-a9ec-0f07bd9e7e73 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:46.709938 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-1c7495dd-aa59-4cbc-9f0a-e9d3f7d5cbb4 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:46.710703 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-1c7495dd-aa59-4cbc-9f0a-e9d3f7d5cbb4 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:46.713215 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell0:SELECT=2 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:33:46.729043 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1c7495dd-aa59-4cbc-9f0a-e9d3f7d5cbb4 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:46.729043 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1c7495dd-aa59-4cbc-9f0a-e9d3f7d5cbb4 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:46.740142 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1c7495dd-aa59-4cbc-9f0a-e9d3f7d5cbb4 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:46.740677 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1c7495dd-aa59-4cbc-9f0a-e9d3f7d5cbb4 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:46.754962 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-64a15846-bc2e-46dc-a9ec-0f07bd9e7e73 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:46.765146 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-64a15846-bc2e-46dc-a9ec-0f07bd9e7e73 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:46.780880 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-64a15846-bc2e-46dc-a9ec-0f07bd9e7e73 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:46.780880 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-64a15846-bc2e-46dc-a9ec-0f07bd9e7e73 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1732 microversion: 2.20 time: 0.185339 Jun 14 18:33:46.780880 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 449/875] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:33:46 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1732 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:33:46.832040 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-1c7495dd-aa59-4cbc-9f0a-e9d3f7d5cbb4 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:46.842600 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-1c7495dd-aa59-4cbc-9f0a-e9d3f7d5cbb4 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1" status: 200 len: 1298 microversion: 2.1 time: 0.145729 Jun 14 18:33:46.843185 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 427/876] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:46 2022] GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1 => generated 1298 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:47.300935 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-700b4853-8f87-4305-8220-5d5a5f592e52 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:47.302009 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-700b4853-8f87-4305-8220-5d5a5f592e52 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:47.322802 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-700b4853-8f87-4305-8220-5d5a5f592e52 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:47.323259 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-700b4853-8f87-4305-8220-5d5a5f592e52 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:47.324048 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-700b4853-8f87-4305-8220-5d5a5f592e52 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:47.324468 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-700b4853-8f87-4305-8220-5d5a5f592e52 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:47.499092 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-700b4853-8f87-4305-8220-5d5a5f592e52 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:47.506922 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-700b4853-8f87-4305-8220-5d5a5f592e52 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1576 microversion: 2.1 time: 0.210377 Jun 14 18:33:47.518765 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 450/877] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:47 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1576 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:47.787194 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-c8bb70f9-8f68-4a33-8a12-0cf6134fb1b3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:47.788039 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-c8bb70f9-8f68-4a33-8a12-0cf6134fb1b3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:47.796862 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c8bb70f9-8f68-4a33-8a12-0cf6134fb1b3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:47.797437 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c8bb70f9-8f68-4a33-8a12-0cf6134fb1b3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:47.798513 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c8bb70f9-8f68-4a33-8a12-0cf6134fb1b3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:47.799282 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c8bb70f9-8f68-4a33-8a12-0cf6134fb1b3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:47.862406 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-2790d75e-610d-498b-a962-b29a75684a02 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:47.865102 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-2790d75e-610d-498b-a962-b29a75684a02 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:47.874667 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2790d75e-610d-498b-a962-b29a75684a02 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:47.875560 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2790d75e-610d-498b-a962-b29a75684a02 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:47.876697 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2790d75e-610d-498b-a962-b29a75684a02 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:47.877535 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2790d75e-610d-498b-a962-b29a75684a02 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:48.119573 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-c8bb70f9-8f68-4a33-8a12-0cf6134fb1b3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:48.133605 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-c8bb70f9-8f68-4a33-8a12-0cf6134fb1b3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:48.136682 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-c8bb70f9-8f68-4a33-8a12-0cf6134fb1b3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:48.137876 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-c8bb70f9-8f68-4a33-8a12-0cf6134fb1b3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1732 microversion: 2.20 time: 0.355103 Jun 14 18:33:48.139247 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 428/878] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:33:47 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1732 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:33:48.152953 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-2790d75e-610d-498b-a962-b29a75684a02 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:48.161790 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-2790d75e-610d-498b-a962-b29a75684a02 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1" status: 200 len: 1363 microversion: 2.1 time: 0.303937 Jun 14 18:33:48.162863 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 451/879] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:47 2022] GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1 => generated 1363 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:48.528105 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-f3d4d925-29cf-4306-ab98-07e22d395c88 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:48.528937 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-f3d4d925-29cf-4306-ab98-07e22d395c88 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:48.537308 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f3d4d925-29cf-4306-ab98-07e22d395c88 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:48.538131 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f3d4d925-29cf-4306-ab98-07e22d395c88 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:48.539269 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f3d4d925-29cf-4306-ab98-07e22d395c88 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:48.540215 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f3d4d925-29cf-4306-ab98-07e22d395c88 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:48.777077 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-f3d4d925-29cf-4306-ab98-07e22d395c88 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:48.785046 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-f3d4d925-29cf-4306-ab98-07e22d395c88 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1576 microversion: 2.1 time: 0.264373 Jun 14 18:33:48.785718 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 429/880] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:48 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1576 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:49.157419 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-c7a42d66-7a7c-4f00-9a9b-66abd6a60886 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:49.158263 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-c7a42d66-7a7c-4f00-9a9b-66abd6a60886 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:49.170992 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c7a42d66-7a7c-4f00-9a9b-66abd6a60886 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:49.171707 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c7a42d66-7a7c-4f00-9a9b-66abd6a60886 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:49.172847 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c7a42d66-7a7c-4f00-9a9b-66abd6a60886 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:49.173536 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c7a42d66-7a7c-4f00-9a9b-66abd6a60886 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:49.179698 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-4a1e0601-39bc-4a44-8f5b-c0be6e2125d8 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:49.181258 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-4a1e0601-39bc-4a44-8f5b-c0be6e2125d8 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:49.195401 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4a1e0601-39bc-4a44-8f5b-c0be6e2125d8 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:49.196201 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4a1e0601-39bc-4a44-8f5b-c0be6e2125d8 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:49.197702 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4a1e0601-39bc-4a44-8f5b-c0be6e2125d8 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:49.198375 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4a1e0601-39bc-4a44-8f5b-c0be6e2125d8 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:49.420141 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-c7a42d66-7a7c-4f00-9a9b-66abd6a60886 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:49.431018 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-c7a42d66-7a7c-4f00-9a9b-66abd6a60886 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:49.432539 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-c7a42d66-7a7c-4f00-9a9b-66abd6a60886 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:49.433743 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-c7a42d66-7a7c-4f00-9a9b-66abd6a60886 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1732 microversion: 2.20 time: 0.281372 Jun 14 18:33:49.434312 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 452/881] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:33:49 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1732 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:33:49.518555 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-4a1e0601-39bc-4a44-8f5b-c0be6e2125d8 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:49.521943 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell1:SELECT=100 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:33:49.526320 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-4a1e0601-39bc-4a44-8f5b-c0be6e2125d8 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1" status: 200 len: 1363 microversion: 2.1 time: 0.350451 Jun 14 18:33:49.536102 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 430/882] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:49 2022] GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1 => generated 1363 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:49.650020 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-d6227386-e2c0-4b61-9cd9-7d3c3a7fac70 req-af80aaf8-83a4-4485-9015-5929c24348a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fed1dbeb-530d-4733-99c1-799e566bf8c1", "tag": "9a82f6b0-da2d-418b-9d02-f617bd45eb15"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:33:49.662693 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-d6227386-e2c0-4b61-9cd9-7d3c3a7fac70 req-af80aaf8-83a4-4485-9015-5929c24348a9 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:49.665359 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-d6227386-e2c0-4b61-9cd9-7d3c3a7fac70 req-af80aaf8-83a4-4485-9015-5929c24348a9 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:49.684839 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-d6227386-e2c0-4b61-9cd9-7d3c3a7fac70 req-af80aaf8-83a4-4485-9015-5929c24348a9 service nova] Creating event network-changed:9a82f6b0-da2d-418b-9d02-f617bd45eb15 for instance fed1dbeb-530d-4733-99c1-799e566bf8c1 on hv-cinder-84456 Jun 14 18:33:49.690332 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-d6227386-e2c0-4b61-9cd9-7d3c3a7fac70 req-af80aaf8-83a4-4485-9015-5929c24348a9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046485 Jun 14 18:33:49.690938 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 453/883] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:33:49.803384 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-45020bcf-d768-4ace-b9e4-cab9f27b48b7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:49.804001 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-45020bcf-d768-4ace-b9e4-cab9f27b48b7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:49.810860 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-45020bcf-d768-4ace-b9e4-cab9f27b48b7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:49.815882 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-45020bcf-d768-4ace-b9e4-cab9f27b48b7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:49.815882 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-45020bcf-d768-4ace-b9e4-cab9f27b48b7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:49.815882 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-45020bcf-d768-4ace-b9e4-cab9f27b48b7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:50.041556 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-45020bcf-d768-4ace-b9e4-cab9f27b48b7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:50.050366 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-45020bcf-d768-4ace-b9e4-cab9f27b48b7 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1563 microversion: 2.1 time: 0.251296 Jun 14 18:33:50.050934 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 431/884] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:49 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1563 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:50.454742 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-bb222fc0-c9e2-4edb-8fba-f9633080882f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:50.455195 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-bb222fc0-c9e2-4edb-8fba-f9633080882f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:50.461971 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-bb222fc0-c9e2-4edb-8fba-f9633080882f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:50.470193 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-bb222fc0-c9e2-4edb-8fba-f9633080882f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:50.470193 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-bb222fc0-c9e2-4edb-8fba-f9633080882f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:50.470193 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-bb222fc0-c9e2-4edb-8fba-f9633080882f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:50.543549 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-d919dcb5-2497-4d63-a3bd-901fad2fd711 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:50.544234 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-d919dcb5-2497-4d63-a3bd-901fad2fd711 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:50.553253 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d919dcb5-2497-4d63-a3bd-901fad2fd711 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:50.553253 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d919dcb5-2497-4d63-a3bd-901fad2fd711 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:50.554134 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d919dcb5-2497-4d63-a3bd-901fad2fd711 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:50.554951 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d919dcb5-2497-4d63-a3bd-901fad2fd711 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:50.621084 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-bb222fc0-c9e2-4edb-8fba-f9633080882f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:50.634111 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-bb222fc0-c9e2-4edb-8fba-f9633080882f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:50.637850 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-bb222fc0-c9e2-4edb-8fba-f9633080882f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:50.642745 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-bb222fc0-c9e2-4edb-8fba-f9633080882f tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1732 microversion: 2.20 time: 0.193971 Jun 14 18:33:50.654829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 454/885] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:33:50 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1732 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:33:50.719419 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-d919dcb5-2497-4d63-a3bd-901fad2fd711 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:50.727808 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-d919dcb5-2497-4d63-a3bd-901fad2fd711 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1" status: 200 len: 1363 microversion: 2.1 time: 0.188528 Jun 14 18:33:50.728397 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 432/886] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:50 2022] GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:33:51.668725 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-feb5061e-e3d4-4123-a72e-2fe72bf6098b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:51.669905 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-feb5061e-e3d4-4123-a72e-2fe72bf6098b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:51.679612 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-feb5061e-e3d4-4123-a72e-2fe72bf6098b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:51.680077 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-feb5061e-e3d4-4123-a72e-2fe72bf6098b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:51.680857 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-feb5061e-e3d4-4123-a72e-2fe72bf6098b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:51.681998 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-feb5061e-e3d4-4123-a72e-2fe72bf6098b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:51.682759 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-75c5af60-c5ef-41a9-b2e5-d0e9a71ca544 req-a73101c1-081f-4b76-8102-25c0901c9f5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86678293-5e78-4bb0-9bc8-0a02da6d1a0b", "name": "network-vif-plugged", "status": "completed", "tag": "9a48c21f-378c-4db8-a26f-6ed7263009cb"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:33:51.699135 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-75c5af60-c5ef-41a9-b2e5-d0e9a71ca544 req-a73101c1-081f-4b76-8102-25c0901c9f5e service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:51.699135 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-75c5af60-c5ef-41a9-b2e5-d0e9a71ca544 req-a73101c1-081f-4b76-8102-25c0901c9f5e service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:51.704137 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-75c5af60-c5ef-41a9-b2e5-d0e9a71ca544 req-a73101c1-081f-4b76-8102-25c0901c9f5e service nova] Creating event network-vif-plugged:9a48c21f-378c-4db8-a26f-6ed7263009cb for instance 86678293-5e78-4bb0-9bc8-0a02da6d1a0b on hv-cinder-84456 Jun 14 18:33:51.709289 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-75c5af60-c5ef-41a9-b2e5-d0e9a71ca544 req-a73101c1-081f-4b76-8102-25c0901c9f5e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030245 Jun 14 18:33:51.709910 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 433/887] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:33:51.746370 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-0db0db52-f241-4820-866b-3aa7b5fb743b tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:51.747286 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-0db0db52-f241-4820-866b-3aa7b5fb743b tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:51.755054 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0db0db52-f241-4820-866b-3aa7b5fb743b tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:51.755496 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0db0db52-f241-4820-866b-3aa7b5fb743b tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:51.756257 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0db0db52-f241-4820-866b-3aa7b5fb743b tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:51.756713 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0db0db52-f241-4820-866b-3aa7b5fb743b tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:51.854438 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-feb5061e-e3d4-4123-a72e-2fe72bf6098b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:51.863924 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-feb5061e-e3d4-4123-a72e-2fe72bf6098b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:51.865627 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-feb5061e-e3d4-4123-a72e-2fe72bf6098b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:51.866962 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-feb5061e-e3d4-4123-a72e-2fe72bf6098b tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1732 microversion: 2.20 time: 0.203236 Jun 14 18:33:51.867610 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 455/888] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:33:51 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1732 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:33:51.901545 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-0db0db52-f241-4820-866b-3aa7b5fb743b tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:51.909897 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-0db0db52-f241-4820-866b-3aa7b5fb743b tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1" status: 200 len: 1363 microversion: 2.1 time: 0.169072 Jun 14 18:33:51.910474 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 434/889] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:51 2022] GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:33:52.886103 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-a8739c9c-5f4d-4e46-87f5-9050c01ae722 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:52.886651 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-a8739c9c-5f4d-4e46-87f5-9050c01ae722 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:52.894594 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a8739c9c-5f4d-4e46-87f5-9050c01ae722 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:52.895089 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a8739c9c-5f4d-4e46-87f5-9050c01ae722 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:52.895863 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a8739c9c-5f4d-4e46-87f5-9050c01ae722 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:52.896302 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a8739c9c-5f4d-4e46-87f5-9050c01ae722 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:52.900583 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell1:SELECT=100 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:33:52.927262 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-645a0367-cec2-490b-a17f-00c59cf4722d tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:52.927986 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-645a0367-cec2-490b-a17f-00c59cf4722d tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:52.934889 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-645a0367-cec2-490b-a17f-00c59cf4722d tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:52.935437 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-645a0367-cec2-490b-a17f-00c59cf4722d tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:52.936356 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-645a0367-cec2-490b-a17f-00c59cf4722d tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:52.937343 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-645a0367-cec2-490b-a17f-00c59cf4722d tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:53.033036 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-a8739c9c-5f4d-4e46-87f5-9050c01ae722 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:53.041737 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-a8739c9c-5f4d-4e46-87f5-9050c01ae722 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:53.043264 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-a8739c9c-5f4d-4e46-87f5-9050c01ae722 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:53.044436 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-a8739c9c-5f4d-4e46-87f5-9050c01ae722 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1732 microversion: 2.20 time: 0.162654 Jun 14 18:33:53.044999 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 456/890] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:33:52 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:33:53.085385 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-645a0367-cec2-490b-a17f-00c59cf4722d tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:53.093957 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-645a0367-cec2-490b-a17f-00c59cf4722d tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1" status: 200 len: 1363 microversion: 2.1 time: 0.170505 Jun 14 18:33:53.094759 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 435/891] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:52 2022] GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:33:54.062673 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-1fb6a5ed-cd2a-4f38-835a-948bdf6d92b1 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:54.063446 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-1fb6a5ed-cd2a-4f38-835a-948bdf6d92b1 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:54.070112 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1fb6a5ed-cd2a-4f38-835a-948bdf6d92b1 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:54.070782 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1fb6a5ed-cd2a-4f38-835a-948bdf6d92b1 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:54.072295 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1fb6a5ed-cd2a-4f38-835a-948bdf6d92b1 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:54.072815 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1fb6a5ed-cd2a-4f38-835a-948bdf6d92b1 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:54.113318 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-8cc86147-8a4b-4ba1-a89c-fed92b348ac1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:54.114648 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-8cc86147-8a4b-4ba1-a89c-fed92b348ac1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:54.122416 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8cc86147-8a4b-4ba1-a89c-fed92b348ac1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:54.123156 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8cc86147-8a4b-4ba1-a89c-fed92b348ac1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:54.138280 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8cc86147-8a4b-4ba1-a89c-fed92b348ac1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:54.150137 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8cc86147-8a4b-4ba1-a89c-fed92b348ac1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:54.238331 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-1fb6a5ed-cd2a-4f38-835a-948bdf6d92b1 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:54.246390 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-1fb6a5ed-cd2a-4f38-835a-948bdf6d92b1 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:54.248140 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-1fb6a5ed-cd2a-4f38-835a-948bdf6d92b1 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:54.249503 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-1fb6a5ed-cd2a-4f38-835a-948bdf6d92b1 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1732 microversion: 2.20 time: 0.191368 Jun 14 18:33:54.250232 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 457/892] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:33:54 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1732 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:33:54.291744 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-8cc86147-8a4b-4ba1-a89c-fed92b348ac1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:54.299554 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-8cc86147-8a4b-4ba1-a89c-fed92b348ac1 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1" status: 200 len: 1363 microversion: 2.1 time: 0.191517 Jun 14 18:33:54.300116 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 436/893] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:54 2022] GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1 => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:55.268370 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-83caaede-8edb-4c1a-9fba-185cc6703136 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:55.269052 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-83caaede-8edb-4c1a-9fba-185cc6703136 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:55.275491 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-83caaede-8edb-4c1a-9fba-185cc6703136 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:55.275930 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-83caaede-8edb-4c1a-9fba-185cc6703136 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:55.276685 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-83caaede-8edb-4c1a-9fba-185cc6703136 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:55.277114 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-83caaede-8edb-4c1a-9fba-185cc6703136 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:55.317121 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-a510311a-c222-4c1a-8ce2-c885e5ce130c tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:55.317908 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-a510311a-c222-4c1a-8ce2-c885e5ce130c tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:55.324783 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a510311a-c222-4c1a-8ce2-c885e5ce130c tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:55.325239 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a510311a-c222-4c1a-8ce2-c885e5ce130c tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:55.326060 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a510311a-c222-4c1a-8ce2-c885e5ce130c tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:55.326497 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a510311a-c222-4c1a-8ce2-c885e5ce130c tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:55.409125 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-83caaede-8edb-4c1a-9fba-185cc6703136 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:55.418826 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-83caaede-8edb-4c1a-9fba-185cc6703136 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:55.420332 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-83caaede-8edb-4c1a-9fba-185cc6703136 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:55.421613 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-83caaede-8edb-4c1a-9fba-185cc6703136 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1719 microversion: 2.20 time: 0.157760 Jun 14 18:33:55.422725 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 458/894] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:33:55 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:33:55.462967 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-a510311a-c222-4c1a-8ce2-c885e5ce130c tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:55.471448 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-a510311a-c222-4c1a-8ce2-c885e5ce130c tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1" status: 200 len: 1363 microversion: 2.1 time: 0.158729 Jun 14 18:33:55.472017 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 437/895] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:55 2022] GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:33:56.239978 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-81b03d93-9ab2-44a8-be8b-3f15f0f6a375 req-8c7803be-3a68-433d-b2ec-ca4c35c43229 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fed1dbeb-530d-4733-99c1-799e566bf8c1", "name": "network-vif-plugged", "status": "completed", "tag": "9a82f6b0-da2d-418b-9d02-f617bd45eb15"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:33:56.247899 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-81b03d93-9ab2-44a8-be8b-3f15f0f6a375 req-8c7803be-3a68-433d-b2ec-ca4c35c43229 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:56.248336 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-81b03d93-9ab2-44a8-be8b-3f15f0f6a375 req-8c7803be-3a68-433d-b2ec-ca4c35c43229 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:56.260168 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-81b03d93-9ab2-44a8-be8b-3f15f0f6a375 req-8c7803be-3a68-433d-b2ec-ca4c35c43229 service nova] Creating event network-vif-plugged:9a82f6b0-da2d-418b-9d02-f617bd45eb15 for instance fed1dbeb-530d-4733-99c1-799e566bf8c1 on hv-cinder-84456 Jun 14 18:33:56.264912 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-81b03d93-9ab2-44a8-be8b-3f15f0f6a375 req-8c7803be-3a68-433d-b2ec-ca4c35c43229 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028700 Jun 14 18:33:56.266286 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 459/896] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:33:56.489503 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-9a56ef75-fff3-42f1-b9df-0c25322092ab tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:56.490018 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-9a56ef75-fff3-42f1-b9df-0c25322092ab tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:56.496562 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9a56ef75-fff3-42f1-b9df-0c25322092ab tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:56.497018 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9a56ef75-fff3-42f1-b9df-0c25322092ab tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:56.497806 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9a56ef75-fff3-42f1-b9df-0c25322092ab tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:56.498250 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9a56ef75-fff3-42f1-b9df-0c25322092ab tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:56.627643 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-9a56ef75-fff3-42f1-b9df-0c25322092ab tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:56.635375 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-9a56ef75-fff3-42f1-b9df-0c25322092ab tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1" status: 200 len: 1363 microversion: 2.1 time: 0.150874 Jun 14 18:33:56.635936 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 438/897] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:56 2022] GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:57.653364 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-b920d1cd-d4d0-4e73-8157-32bd1ee5c56b tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:57.654140 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-b920d1cd-d4d0-4e73-8157-32bd1ee5c56b tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:57.660487 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b920d1cd-d4d0-4e73-8157-32bd1ee5c56b tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:57.660932 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b920d1cd-d4d0-4e73-8157-32bd1ee5c56b tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:57.661728 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b920d1cd-d4d0-4e73-8157-32bd1ee5c56b tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:57.662165 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b920d1cd-d4d0-4e73-8157-32bd1ee5c56b tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:57.801654 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-b920d1cd-d4d0-4e73-8157-32bd1ee5c56b tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:57.809123 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-b920d1cd-d4d0-4e73-8157-32bd1ee5c56b tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1" status: 200 len: 1363 microversion: 2.1 time: 0.160646 Jun 14 18:33:57.809803 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 460/898] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:57 2022] GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:58.827182 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-b9043078-429f-4cc4-bafc-54a73c49176c tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:58.827785 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-b9043078-429f-4cc4-bafc-54a73c49176c tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:33:58.834853 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b9043078-429f-4cc4-bafc-54a73c49176c tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:58.835305 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b9043078-429f-4cc4-bafc-54a73c49176c tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:58.836053 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b9043078-429f-4cc4-bafc-54a73c49176c tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:33:58.836581 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b9043078-429f-4cc4-bafc-54a73c49176c tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:33:58.970860 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-b9043078-429f-4cc4-bafc-54a73c49176c tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:33:58.978638 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-b9043078-429f-4cc4-bafc-54a73c49176c tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1" status: 200 len: 1363 microversion: 2.1 time: 0.155441 Jun 14 18:33:58.979184 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 439/899] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:58 2022] GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:33:59.996479 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-f75f7d01-319f-4a8d-ab56-f0c6ebeb5ae5 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:33:59.997085 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-f75f7d01-319f-4a8d-ab56-f0c6ebeb5ae5 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:34:00.003748 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f75f7d01-319f-4a8d-ab56-f0c6ebeb5ae5 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:34:00.004203 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f75f7d01-319f-4a8d-ab56-f0c6ebeb5ae5 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:34:00.004962 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f75f7d01-319f-4a8d-ab56-f0c6ebeb5ae5 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:34:00.005424 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f75f7d01-319f-4a8d-ab56-f0c6ebeb5ae5 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:34:00.137718 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-f75f7d01-319f-4a8d-ab56-f0c6ebeb5ae5 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:34:00.145801 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-f75f7d01-319f-4a8d-ab56-f0c6ebeb5ae5 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1" status: 200 len: 1363 microversion: 2.1 time: 0.153262 Jun 14 18:34:00.146404 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 461/900] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:33:59 2022] GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:34:01.163172 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-998b3a32-43e7-4cdd-af9d-11345c8d6d86 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:34:01.163778 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-998b3a32-43e7-4cdd-af9d-11345c8d6d86 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:34:01.170484 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-998b3a32-43e7-4cdd-af9d-11345c8d6d86 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:34:01.170928 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-998b3a32-43e7-4cdd-af9d-11345c8d6d86 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:34:01.172204 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-998b3a32-43e7-4cdd-af9d-11345c8d6d86 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:34:01.172716 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-998b3a32-43e7-4cdd-af9d-11345c8d6d86 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:34:01.303725 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-998b3a32-43e7-4cdd-af9d-11345c8d6d86 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:34:01.311194 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-998b3a32-43e7-4cdd-af9d-11345c8d6d86 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1" status: 200 len: 1363 microversion: 2.1 time: 0.152385 Jun 14 18:34:01.311784 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 440/901] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:34:01 2022] GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:34:02.329824 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-9734b1ad-7690-4319-a7cc-c5341f0bf89d tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:34:02.330457 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-9734b1ad-7690-4319-a7cc-c5341f0bf89d tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:34:02.337174 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9734b1ad-7690-4319-a7cc-c5341f0bf89d tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:34:02.337667 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9734b1ad-7690-4319-a7cc-c5341f0bf89d tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:34:02.338467 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9734b1ad-7690-4319-a7cc-c5341f0bf89d tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:34:02.338909 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9734b1ad-7690-4319-a7cc-c5341f0bf89d tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:34:02.475265 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-9734b1ad-7690-4319-a7cc-c5341f0bf89d tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:34:02.483460 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-9734b1ad-7690-4319-a7cc-c5341f0bf89d tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1" status: 200 len: 1363 microversion: 2.1 time: 0.158526 Jun 14 18:34:02.484193 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 462/902] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:34:02 2022] GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:34:03.500463 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-919e2952-5ff6-45be-99fb-0b55ff865db4 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:34:03.501038 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-919e2952-5ff6-45be-99fb-0b55ff865db4 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:34:03.507891 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-919e2952-5ff6-45be-99fb-0b55ff865db4 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:34:03.508350 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-919e2952-5ff6-45be-99fb-0b55ff865db4 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:34:03.510490 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-919e2952-5ff6-45be-99fb-0b55ff865db4 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:34:03.510490 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-919e2952-5ff6-45be-99fb-0b55ff865db4 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:34:03.644649 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-919e2952-5ff6-45be-99fb-0b55ff865db4 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:34:03.652229 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-919e2952-5ff6-45be-99fb-0b55ff865db4 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1" status: 200 len: 1552 microversion: 2.1 time: 0.155936 Jun 14 18:34:03.652786 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 441/903] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:34:03 2022] GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1 => generated 1552 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:34:03.668905 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-384f0dd8-2fdc-4e4f-818b-51a13df8c851 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:34:03.669433 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-384f0dd8-2fdc-4e4f-818b-51a13df8c851 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:34:03.676550 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-384f0dd8-2fdc-4e4f-818b-51a13df8c851 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:34:03.680413 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-384f0dd8-2fdc-4e4f-818b-51a13df8c851 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:34:03.680413 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-384f0dd8-2fdc-4e4f-818b-51a13df8c851 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:34:03.680413 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-384f0dd8-2fdc-4e4f-818b-51a13df8c851 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:34:03.758571 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-384f0dd8-2fdc-4e4f-818b-51a13df8c851 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093759 Jun 14 18:34:03.759172 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 463/904] 10.222.0.78 () {58 vars in 1274 bytes} [Tue Jun 14 18:34:03 2022] GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:34:04.762244 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-4e1e0f45-090e-41c1-9a56-fd4606cd96f2 req-764e125d-39c9-4c19-b2a9-be060e2f168d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fed1dbeb-530d-4733-99c1-799e566bf8c1", "tag": "9a82f6b0-da2d-418b-9d02-f617bd45eb15"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:34:04.771314 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-4e1e0f45-090e-41c1-9a56-fd4606cd96f2 req-764e125d-39c9-4c19-b2a9-be060e2f168d service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:34:04.771844 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-4e1e0f45-090e-41c1-9a56-fd4606cd96f2 req-764e125d-39c9-4c19-b2a9-be060e2f168d service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:34:04.784063 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-4e1e0f45-090e-41c1-9a56-fd4606cd96f2 req-764e125d-39c9-4c19-b2a9-be060e2f168d service nova] Creating event network-changed:9a82f6b0-da2d-418b-9d02-f617bd45eb15 for instance fed1dbeb-530d-4733-99c1-799e566bf8c1 on hv-cinder-84456 Jun 14 18:34:04.789357 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-4e1e0f45-090e-41c1-9a56-fd4606cd96f2 req-764e125d-39c9-4c19-b2a9-be060e2f168d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031023 Jun 14 18:34:04.793843 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 442/905] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:34:35.688009 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_api:SELECT=31 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:34:35.689224 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell1:SELECT=41 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:34:35.693556 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-82fc3c72-fb93-4dc0-aa04-61783de1c1db tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:34:35.694585 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-82fc3c72-fb93-4dc0-aa04-61783de1c1db tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:34:35.700597 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-82fc3c72-fb93-4dc0-aa04-61783de1c1db tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:34:35.701172 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-82fc3c72-fb93-4dc0-aa04-61783de1c1db tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:34:35.710820 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-82fc3c72-fb93-4dc0-aa04-61783de1c1db tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:34:35.710820 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-82fc3c72-fb93-4dc0-aa04-61783de1c1db tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:34:35.737328 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-82fc3c72-fb93-4dc0-aa04-61783de1c1db tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050865 Jun 14 18:34:35.738286 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 464/906] 10.222.0.78 () {60 vars in 1342 bytes} [Tue Jun 14 18:34:35 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:34:35.796180 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_api:SELECT=35 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:34:35.797020 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell1:SELECT=64 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:34:35.801097 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-0ad9fc2f-e0a9-48a7-b8de-375bc5659215 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:34:35.801699 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-0ad9fc2f-e0a9-48a7-b8de-375bc5659215 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:34:35.807648 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0ad9fc2f-e0a9-48a7-b8de-375bc5659215 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:34:35.808260 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0ad9fc2f-e0a9-48a7-b8de-375bc5659215 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:34:35.808891 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0ad9fc2f-e0a9-48a7-b8de-375bc5659215 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:34:35.809432 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0ad9fc2f-e0a9-48a7-b8de-375bc5659215 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:34:35.835546 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-0ad9fc2f-e0a9-48a7-b8de-375bc5659215 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Going to try to terminate instance {{(pid=118623) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:34:36.153147 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-0ad9fc2f-e0a9-48a7-b8de-375bc5659215 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "DELETE /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 204 len: 0 microversion: 2.20 time: 0.359291 Jun 14 18:34:36.153800 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 443/907] 10.222.0.78 () {60 vars in 1279 bytes} [Tue Jun 14 18:34:35 2022] DELETE /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 14 18:34:36.162466 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-3d8e8791-417f-48ae-b75c-63a901ed9882 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:34:36.167177 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-3d8e8791-417f-48ae-b75c-63a901ed9882 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:34:36.169922 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3d8e8791-417f-48ae-b75c-63a901ed9882 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:34:36.170952 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3d8e8791-417f-48ae-b75c-63a901ed9882 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:34:36.171726 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3d8e8791-417f-48ae-b75c-63a901ed9882 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:34:36.172157 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3d8e8791-417f-48ae-b75c-63a901ed9882 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:34:36.305903 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-3d8e8791-417f-48ae-b75c-63a901ed9882 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:34:36.314302 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-3d8e8791-417f-48ae-b75c-63a901ed9882 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:34:36.315817 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-3d8e8791-417f-48ae-b75c-63a901ed9882 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:34:36.316974 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-3d8e8791-417f-48ae-b75c-63a901ed9882 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1725 microversion: 2.20 time: 0.158462 Jun 14 18:34:36.317610 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 465/908] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:34:36 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:34:37.336157 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-e711fd09-e417-4139-b1e2-c8d01b25e5c1 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:34:37.336874 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-e711fd09-e417-4139-b1e2-c8d01b25e5c1 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:34:37.343870 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e711fd09-e417-4139-b1e2-c8d01b25e5c1 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:34:37.344308 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e711fd09-e417-4139-b1e2-c8d01b25e5c1 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:34:37.345076 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e711fd09-e417-4139-b1e2-c8d01b25e5c1 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:34:37.345535 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e711fd09-e417-4139-b1e2-c8d01b25e5c1 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:34:37.482832 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-e711fd09-e417-4139-b1e2-c8d01b25e5c1 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:34:37.491423 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-e711fd09-e417-4139-b1e2-c8d01b25e5c1 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:34:37.492933 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-e711fd09-e417-4139-b1e2-c8d01b25e5c1 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:34:37.494145 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-e711fd09-e417-4139-b1e2-c8d01b25e5c1 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1725 microversion: 2.20 time: 0.162236 Jun 14 18:34:37.494702 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 444/909] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:34:37 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:34:38.513573 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-3b7a4ba1-ad84-4396-9477-6488e33d2785 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:34:38.514220 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-3b7a4ba1-ad84-4396-9477-6488e33d2785 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:34:38.522102 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3b7a4ba1-ad84-4396-9477-6488e33d2785 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:34:38.522553 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3b7a4ba1-ad84-4396-9477-6488e33d2785 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:34:38.523322 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3b7a4ba1-ad84-4396-9477-6488e33d2785 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:34:38.523747 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3b7a4ba1-ad84-4396-9477-6488e33d2785 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:34:38.589585 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-3b7a4ba1-ad84-4396-9477-6488e33d2785 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:34:38.597818 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-3b7a4ba1-ad84-4396-9477-6488e33d2785 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:34:38.599506 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-3b7a4ba1-ad84-4396-9477-6488e33d2785 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:34:38.601129 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-3b7a4ba1-ad84-4396-9477-6488e33d2785 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1658 microversion: 2.20 time: 0.091727 Jun 14 18:34:38.601934 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 466/910] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:34:38 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1658 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:34:38.672726 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-ec72179b-ce26-4945-aa64-95069fd39079 req-054f572c-da6c-4e3e-b989-2ed34d541e76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86678293-5e78-4bb0-9bc8-0a02da6d1a0b", "name": "network-vif-deleted", "tag": "9a48c21f-378c-4db8-a26f-6ed7263009cb"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:34:38.681475 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-ec72179b-ce26-4945-aa64-95069fd39079 req-054f572c-da6c-4e3e-b989-2ed34d541e76 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:34:38.682020 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-ec72179b-ce26-4945-aa64-95069fd39079 req-054f572c-da6c-4e3e-b989-2ed34d541e76 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:34:38.694530 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-ec72179b-ce26-4945-aa64-95069fd39079 req-054f572c-da6c-4e3e-b989-2ed34d541e76 service nova] Creating event network-vif-deleted:9a48c21f-378c-4db8-a26f-6ed7263009cb for instance 86678293-5e78-4bb0-9bc8-0a02da6d1a0b on hv-cinder-84456 Jun 14 18:34:38.699835 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-ec72179b-ce26-4945-aa64-95069fd39079 req-054f572c-da6c-4e3e-b989-2ed34d541e76 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031426 Jun 14 18:34:38.700602 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 445/911] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:34:39.623391 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-a1109c78-d284-4112-bb87-4a463bb80306 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:34:39.623391 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-a1109c78-d284-4112-bb87-4a463bb80306 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:34:39.629949 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a1109c78-d284-4112-bb87-4a463bb80306 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:34:39.630480 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a1109c78-d284-4112-bb87-4a463bb80306 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:34:39.631229 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a1109c78-d284-4112-bb87-4a463bb80306 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:34:39.631689 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a1109c78-d284-4112-bb87-4a463bb80306 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:34:39.665748 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a1109c78-d284-4112-bb87-4a463bb80306 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:34:39.666199 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a1109c78-d284-4112-bb87-4a463bb80306 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:34:39.666651 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.objects.instance [None req-a1109c78-d284-4112-bb87-4a463bb80306 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lazy-loading 'fault' on Instance uuid 86678293-5e78-4bb0-9bc8-0a02da6d1a0b {{(pid=118624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:34:39.710092 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-a1109c78-d284-4112-bb87-4a463bb80306 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:34:39.717983 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-a1109c78-d284-4112-bb87-4a463bb80306 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:34:39.720106 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-a1109c78-d284-4112-bb87-4a463bb80306 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76baaf45903d4c53ab3e0fe459b228ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8603a3b1604479da86224c52c2467ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:34:39.723715 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-a1109c78-d284-4112-bb87-4a463bb80306 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 200 len: 1372 microversion: 2.20 time: 0.104881 Jun 14 18:34:39.723715 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 467/912] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:34:39 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 1372 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:34:40.744260 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-267d12fa-c086-4a55-8639-dde578a68754 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:34:40.744950 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-267d12fa-c086-4a55-8639-dde578a68754 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:34:40.752246 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-267d12fa-c086-4a55-8639-dde578a68754 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:34:40.752695 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-267d12fa-c086-4a55-8639-dde578a68754 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:34:40.753477 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-267d12fa-c086-4a55-8639-dde578a68754 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:34:40.753961 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-267d12fa-c086-4a55-8639-dde578a68754 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:34:40.768085 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.wsgi [None req-267d12fa-c086-4a55-8639-dde578a68754 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] HTTP exception thrown: Instance 86678293-5e78-4bb0-9bc8-0a02da6d1a0b could not be found. Jun 14 18:34:40.769768 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-267d12fa-c086-4a55-8639-dde578a68754 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Request method failure captured: Jun 14 18:34:40.769768 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: request: GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b HTTP/1.1 Jun 14 18:34:40.769768 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept: application/json Jun 14 18:34:40.769768 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept-Encoding: identity Jun 14 18:34:40.769768 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Connection: close Jun 14 18:34:40.769768 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Length: 0 Jun 14 18:34:40.769768 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Type: application/json Jun 14 18:34:40.769768 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Host: 10.222.0.78 Jun 14 18:34:40.769768 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Openstack-System-Scope: None Jun 14 18:34:40.769768 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: User-Agent: python-urllib3/1.26.9 Jun 14 18:34:40.769768 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Auth-Token: gAAAAABiqNMFJuicSA_x3LAwtlTtL0woYIYWPVyzRBuu2w3gIFz8zwkFCJVgYXMmymY6Og8Q-JCquDKlggQ9BBzvZMZGA1Cg_iP1ACfiqqk9tEBoFtdzgUZok99MmOP28xoQ8P2eYjOVjHuIg3g70dWaiW6WYAMhzP1q7mnjqOrn3stEWOIBfsk Jun 14 18:34:40.769768 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Id: None Jun 14 18:34:40.769768 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Name: None Jun 14 18:34:40.769768 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Identity-Status: Confirmed Jun 14 18:34:40.769768 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Is-Admin-Project: True Jun 14 18:34:40.769768 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Openstack-Nova-Api-Version: 2.20 Jun 14 18:34:40.769768 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Id: default Jun 14 18:34:40.769768 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Name: Default Jun 14 18:34:40.769768 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Id: e8603a3b1604479da86224c52c2467ad Jun 14 18:34:40.769768 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-993386760 Jun 14 18:34:40.769768 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Role: reader,member Jun 14 18:34:40.769768 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Roles: reader,member Jun 14 18:34:40.771428 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e8603a3b1604479da86224c52c2467ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e8603a3b1604479da86224c52c2467ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e8603a3b1604479da86224c52c2467ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e8603a3b1604479da86224c52c2467ad"}]}] Jun 14 18:34:40.771428 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant: tempest-AttachVolumeShelveTestJSON-993386760 Jun 14 18:34:40.771428 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Id: e8603a3b1604479da86224c52c2467ad Jun 14 18:34:40.771428 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-993386760 Jun 14 18:34:40.771428 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User: tempest-AttachVolumeShelveTestJSON-993386760-project Jun 14 18:34:40.771428 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Id: default Jun 14 18:34:40.771428 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Name: Default Jun 14 18:34:40.771428 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Id: 76baaf45903d4c53ab3e0fe459b228ea Jun 14 18:34:40.771428 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Name: tempest-AttachVolumeShelveTestJSON-993386760-project Jun 14 18:34:40.771428 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: method: > Jun 14 18:34:40.771428 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: exception: Instance 86678293-5e78-4bb0-9bc8-0a02da6d1a0b could not be found. Jun 14 18:34:40.771428 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: action_args: {'id': '86678293-5e78-4bb0-9bc8-0a02da6d1a0b'} Jun 14 18:34:40.772338 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:34:40.772338 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:34:40.772338 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:34:40.772338 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:34:40.772338 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:34:40.772338 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:34:40.772338 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:34:40.772338 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:34:40.772338 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:34:40.772338 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:34:40.772338 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86678293-5e78-4bb0-9bc8-0a02da6d1a0b could not be found. Jun 14 18:34:40.772338 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:34:40.772338 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:34:40.772338 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:34:40.772338 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:34:40.772338 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:34:40.772338 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:34:40.772338 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:34:40.772338 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:34:40.772338 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:34:40.773912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:34:40.773912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:34:40.773912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:34:40.773912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:34:40.773912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:34:40.773912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:34:40.773912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:34:40.773912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86678293-5e78-4bb0-9bc8-0a02da6d1a0b could not be found. Jun 14 18:34:40.773912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:34:40.773912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:34:40.773912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:34:40.773912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:34:40.773912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:34:40.773912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:34:40.773912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:34:40.773912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:34:40.773912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86678293-5e78-4bb0-9bc8-0a02da6d1a0b could not be found. Jun 14 18:34:40.773912 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:34:40.775561 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-267d12fa-c086-4a55-8639-dde578a68754 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Returning 404 to user: Instance 86678293-5e78-4bb0-9bc8-0a02da6d1a0b could not be found. {{(pid=118623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:34:40.775561 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-267d12fa-c086-4a55-8639-dde578a68754 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 404 len: 111 microversion: 2.20 time: 0.031811 Jun 14 18:34:40.775561 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 446/913] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:34:40 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 14 18:34:40.780250 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-2093b7ff-cbe6-4026-8d1e-7fda3f3326a3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '.version_select at 0x7efe70617160>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:34:40.876014 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-2093b7ff-cbe6-4026-8d1e-7fda3f3326a3 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1222989990" status: 204 len: 0 microversion: 2.20 time: 0.099392 Jun 14 18:34:40.876791 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 468/914] 10.222.0.78 () {60 vars in 1261 bytes} [Tue Jun 14 18:34:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1222989990 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 14 18:34:42.960483 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-12d340ab-2094-4fa2-97de-131cc55a7806 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:34:42.960977 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-12d340ab-2094-4fa2-97de-131cc55a7806 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:34:42.967471 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-12d340ab-2094-4fa2-97de-131cc55a7806 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:34:42.967925 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-12d340ab-2094-4fa2-97de-131cc55a7806 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:34:42.968845 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-12d340ab-2094-4fa2-97de-131cc55a7806 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:34:42.969281 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-12d340ab-2094-4fa2-97de-131cc55a7806 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:34:42.982357 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.wsgi [None req-12d340ab-2094-4fa2-97de-131cc55a7806 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] HTTP exception thrown: Instance 86678293-5e78-4bb0-9bc8-0a02da6d1a0b could not be found. Jun 14 18:34:42.984595 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-12d340ab-2094-4fa2-97de-131cc55a7806 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Request method failure captured: Jun 14 18:34:42.984595 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: request: DELETE /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b HTTP/1.1 Jun 14 18:34:42.984595 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept: application/json Jun 14 18:34:42.984595 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept-Encoding: identity Jun 14 18:34:42.984595 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Connection: close Jun 14 18:34:42.984595 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Length: 0 Jun 14 18:34:42.984595 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Type: application/json Jun 14 18:34:42.984595 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Host: 10.222.0.78 Jun 14 18:34:42.984595 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Openstack-System-Scope: None Jun 14 18:34:42.984595 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: User-Agent: python-urllib3/1.26.9 Jun 14 18:34:42.984595 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Auth-Token: gAAAAABiqNMFJuicSA_x3LAwtlTtL0woYIYWPVyzRBuu2w3gIFz8zwkFCJVgYXMmymY6Og8Q-JCquDKlggQ9BBzvZMZGA1Cg_iP1ACfiqqk9tEBoFtdzgUZok99MmOP28xoQ8P2eYjOVjHuIg3g70dWaiW6WYAMhzP1q7mnjqOrn3stEWOIBfsk Jun 14 18:34:42.984595 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Id: None Jun 14 18:34:42.984595 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Name: None Jun 14 18:34:42.984595 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Identity-Status: Confirmed Jun 14 18:34:42.984595 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Is-Admin-Project: True Jun 14 18:34:42.984595 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Openstack-Nova-Api-Version: 2.20 Jun 14 18:34:42.984595 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Id: default Jun 14 18:34:42.984595 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Name: Default Jun 14 18:34:42.984595 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Id: e8603a3b1604479da86224c52c2467ad Jun 14 18:34:42.984595 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-993386760 Jun 14 18:34:42.984595 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Role: reader,member Jun 14 18:34:42.984595 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Roles: reader,member Jun 14 18:34:42.986288 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e8603a3b1604479da86224c52c2467ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e8603a3b1604479da86224c52c2467ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e8603a3b1604479da86224c52c2467ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e8603a3b1604479da86224c52c2467ad"}]}] Jun 14 18:34:42.986288 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant: tempest-AttachVolumeShelveTestJSON-993386760 Jun 14 18:34:42.986288 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Id: e8603a3b1604479da86224c52c2467ad Jun 14 18:34:42.986288 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-993386760 Jun 14 18:34:42.986288 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User: tempest-AttachVolumeShelveTestJSON-993386760-project Jun 14 18:34:42.986288 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Id: default Jun 14 18:34:42.986288 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Name: Default Jun 14 18:34:42.986288 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Id: 76baaf45903d4c53ab3e0fe459b228ea Jun 14 18:34:42.986288 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Name: tempest-AttachVolumeShelveTestJSON-993386760-project Jun 14 18:34:42.986288 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: method: > Jun 14 18:34:42.986288 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: exception: Instance 86678293-5e78-4bb0-9bc8-0a02da6d1a0b could not be found. Jun 14 18:34:42.986288 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: action_args: {'id': '86678293-5e78-4bb0-9bc8-0a02da6d1a0b'} Jun 14 18:34:42.987167 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:34:42.987167 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:34:42.987167 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:34:42.987167 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:34:42.987167 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:34:42.987167 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:34:42.987167 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:34:42.987167 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:34:42.987167 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:34:42.987167 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:34:42.987167 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86678293-5e78-4bb0-9bc8-0a02da6d1a0b could not be found. Jun 14 18:34:42.987167 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:34:42.987167 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:34:42.987167 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:34:42.987167 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:34:42.987167 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:34:42.987167 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:34:42.987167 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:34:42.987167 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:34:42.987167 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:34:42.988478 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:34:42.988478 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 14 18:34:42.988478 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 14 18:34:42.988478 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 14 18:34:42.988478 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 14 18:34:42.988478 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:34:42.988478 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:34:42.988478 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:34:42.988478 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:34:42.988478 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86678293-5e78-4bb0-9bc8-0a02da6d1a0b could not be found. Jun 14 18:34:42.988478 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:34:42.988478 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:34:42.988478 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:34:42.988478 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:34:42.988478 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:34:42.988478 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:34:42.988478 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:34:42.988478 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:34:42.988478 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86678293-5e78-4bb0-9bc8-0a02da6d1a0b could not be found. Jun 14 18:34:42.988478 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:34:42.989700 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-12d340ab-2094-4fa2-97de-131cc55a7806 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Returning 404 to user: Instance 86678293-5e78-4bb0-9bc8-0a02da6d1a0b could not be found. {{(pid=118623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:34:42.989700 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-12d340ab-2094-4fa2-97de-131cc55a7806 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "DELETE /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 404 len: 111 microversion: 2.20 time: 0.029359 Jun 14 18:34:42.989700 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 447/915] 10.222.0.78 () {60 vars in 1279 bytes} [Tue Jun 14 18:34:42 2022] DELETE /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 14 18:34:42.994934 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-9e9fa726-dea0-4c89-b5c1-b2dc2732d88c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:34:42.995537 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-9e9fa726-dea0-4c89-b5c1-b2dc2732d88c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 86678293-5e78-4bb0-9bc8-0a02da6d1a0b] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:34:43.002951 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9e9fa726-dea0-4c89-b5c1-b2dc2732d88c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:34:43.003395 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9e9fa726-dea0-4c89-b5c1-b2dc2732d88c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:34:43.004150 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9e9fa726-dea0-4c89-b5c1-b2dc2732d88c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:34:43.004584 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9e9fa726-dea0-4c89-b5c1-b2dc2732d88c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:34:43.017436 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.wsgi [None req-9e9fa726-dea0-4c89-b5c1-b2dc2732d88c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] HTTP exception thrown: Instance 86678293-5e78-4bb0-9bc8-0a02da6d1a0b could not be found. Jun 14 18:34:43.019085 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-9e9fa726-dea0-4c89-b5c1-b2dc2732d88c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Request method failure captured: Jun 14 18:34:43.019085 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: request: GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b HTTP/1.1 Jun 14 18:34:43.019085 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept: application/json Jun 14 18:34:43.019085 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept-Encoding: identity Jun 14 18:34:43.019085 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Connection: close Jun 14 18:34:43.019085 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Length: 0 Jun 14 18:34:43.019085 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Type: application/json Jun 14 18:34:43.019085 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Host: 10.222.0.78 Jun 14 18:34:43.019085 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Openstack-System-Scope: None Jun 14 18:34:43.019085 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: User-Agent: python-urllib3/1.26.9 Jun 14 18:34:43.019085 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Auth-Token: gAAAAABiqNMFJuicSA_x3LAwtlTtL0woYIYWPVyzRBuu2w3gIFz8zwkFCJVgYXMmymY6Og8Q-JCquDKlggQ9BBzvZMZGA1Cg_iP1ACfiqqk9tEBoFtdzgUZok99MmOP28xoQ8P2eYjOVjHuIg3g70dWaiW6WYAMhzP1q7mnjqOrn3stEWOIBfsk Jun 14 18:34:43.019085 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Id: None Jun 14 18:34:43.019085 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Name: None Jun 14 18:34:43.019085 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Identity-Status: Confirmed Jun 14 18:34:43.019085 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Is-Admin-Project: True Jun 14 18:34:43.019085 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Openstack-Nova-Api-Version: 2.20 Jun 14 18:34:43.019085 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Id: default Jun 14 18:34:43.019085 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Name: Default Jun 14 18:34:43.019085 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Id: e8603a3b1604479da86224c52c2467ad Jun 14 18:34:43.019085 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-993386760 Jun 14 18:34:43.019085 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Role: reader,member Jun 14 18:34:43.019085 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Roles: reader,member Jun 14 18:34:43.020664 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e8603a3b1604479da86224c52c2467ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e8603a3b1604479da86224c52c2467ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e8603a3b1604479da86224c52c2467ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e8603a3b1604479da86224c52c2467ad"}]}] Jun 14 18:34:43.020664 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant: tempest-AttachVolumeShelveTestJSON-993386760 Jun 14 18:34:43.020664 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Id: e8603a3b1604479da86224c52c2467ad Jun 14 18:34:43.020664 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-993386760 Jun 14 18:34:43.020664 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User: tempest-AttachVolumeShelveTestJSON-993386760-project Jun 14 18:34:43.020664 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Id: default Jun 14 18:34:43.020664 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Name: Default Jun 14 18:34:43.020664 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Id: 76baaf45903d4c53ab3e0fe459b228ea Jun 14 18:34:43.020664 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Name: tempest-AttachVolumeShelveTestJSON-993386760-project Jun 14 18:34:43.020664 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: method: > Jun 14 18:34:43.020664 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: exception: Instance 86678293-5e78-4bb0-9bc8-0a02da6d1a0b could not be found. Jun 14 18:34:43.020664 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: action_args: {'id': '86678293-5e78-4bb0-9bc8-0a02da6d1a0b'} Jun 14 18:34:43.021567 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:34:43.021567 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:34:43.021567 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:34:43.021567 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:34:43.021567 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:34:43.021567 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:34:43.021567 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:34:43.021567 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:34:43.021567 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:34:43.021567 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:34:43.021567 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86678293-5e78-4bb0-9bc8-0a02da6d1a0b could not be found. Jun 14 18:34:43.021567 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:34:43.021567 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:34:43.021567 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:34:43.021567 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:34:43.021567 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:34:43.021567 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:34:43.021567 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:34:43.021567 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:34:43.021567 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:34:43.022993 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:34:43.022993 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:34:43.022993 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:34:43.022993 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:34:43.022993 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:34:43.022993 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:34:43.022993 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:34:43.022993 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86678293-5e78-4bb0-9bc8-0a02da6d1a0b could not be found. Jun 14 18:34:43.022993 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:34:43.022993 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:34:43.022993 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:34:43.022993 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:34:43.022993 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:34:43.022993 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:34:43.022993 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:34:43.022993 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:34:43.022993 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86678293-5e78-4bb0-9bc8-0a02da6d1a0b could not be found. Jun 14 18:34:43.022993 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:34:43.024414 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-9e9fa726-dea0-4c89-b5c1-b2dc2732d88c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Returning 404 to user: Instance 86678293-5e78-4bb0-9bc8-0a02da6d1a0b could not be found. {{(pid=118624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:34:43.024414 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-9e9fa726-dea0-4c89-b5c1-b2dc2732d88c tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b" status: 404 len: 111 microversion: 2.20 time: 0.029845 Jun 14 18:34:43.024414 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 469/916] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:34:42 2022] GET /compute/v2.1/servers/86678293-5e78-4bb0-9bc8-0a02da6d1a0b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 14 18:34:44.284270 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-a97e9184-1e90-4ec2-82bc-85181f35ed06 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:34:44.284763 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-a97e9184-1e90-4ec2-82bc-85181f35ed06 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:34:44.291684 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a97e9184-1e90-4ec2-82bc-85181f35ed06 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:34:44.292134 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a97e9184-1e90-4ec2-82bc-85181f35ed06 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:34:44.292898 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a97e9184-1e90-4ec2-82bc-85181f35ed06 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:34:44.293337 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a97e9184-1e90-4ec2-82bc-85181f35ed06 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:34:44.307216 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.wsgi [None req-a97e9184-1e90-4ec2-82bc-85181f35ed06 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] HTTP exception thrown: Instance 2876875b-5dbe-4032-949a-3357292296a2 could not be found. Jun 14 18:34:44.308794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-a97e9184-1e90-4ec2-82bc-85181f35ed06 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Request method failure captured: Jun 14 18:34:44.308794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: request: DELETE /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 HTTP/1.1 Jun 14 18:34:44.308794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept: application/json Jun 14 18:34:44.308794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept-Encoding: identity Jun 14 18:34:44.308794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Connection: close Jun 14 18:34:44.308794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Length: 0 Jun 14 18:34:44.308794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Type: application/json Jun 14 18:34:44.308794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Host: 10.222.0.78 Jun 14 18:34:44.308794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Openstack-System-Scope: None Jun 14 18:34:44.308794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: User-Agent: python-urllib3/1.26.9 Jun 14 18:34:44.308794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Auth-Token: gAAAAABiqNMFJuicSA_x3LAwtlTtL0woYIYWPVyzRBuu2w3gIFz8zwkFCJVgYXMmymY6Og8Q-JCquDKlggQ9BBzvZMZGA1Cg_iP1ACfiqqk9tEBoFtdzgUZok99MmOP28xoQ8P2eYjOVjHuIg3g70dWaiW6WYAMhzP1q7mnjqOrn3stEWOIBfsk Jun 14 18:34:44.308794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Id: None Jun 14 18:34:44.308794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Name: None Jun 14 18:34:44.308794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Identity-Status: Confirmed Jun 14 18:34:44.308794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Is-Admin-Project: True Jun 14 18:34:44.308794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Openstack-Nova-Api-Version: 2.20 Jun 14 18:34:44.308794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Id: default Jun 14 18:34:44.308794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Name: Default Jun 14 18:34:44.308794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Id: e8603a3b1604479da86224c52c2467ad Jun 14 18:34:44.308794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-993386760 Jun 14 18:34:44.308794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Role: reader,member Jun 14 18:34:44.308794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Roles: reader,member Jun 14 18:34:44.310499 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e8603a3b1604479da86224c52c2467ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e8603a3b1604479da86224c52c2467ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e8603a3b1604479da86224c52c2467ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e8603a3b1604479da86224c52c2467ad"}]}] Jun 14 18:34:44.310499 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant: tempest-AttachVolumeShelveTestJSON-993386760 Jun 14 18:34:44.310499 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Id: e8603a3b1604479da86224c52c2467ad Jun 14 18:34:44.310499 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-993386760 Jun 14 18:34:44.310499 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User: tempest-AttachVolumeShelveTestJSON-993386760-project Jun 14 18:34:44.310499 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Id: default Jun 14 18:34:44.310499 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Name: Default Jun 14 18:34:44.310499 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Id: 76baaf45903d4c53ab3e0fe459b228ea Jun 14 18:34:44.310499 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Name: tempest-AttachVolumeShelveTestJSON-993386760-project Jun 14 18:34:44.310499 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: method: > Jun 14 18:34:44.310499 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: exception: Instance 2876875b-5dbe-4032-949a-3357292296a2 could not be found. Jun 14 18:34:44.310499 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: action_args: {'id': '2876875b-5dbe-4032-949a-3357292296a2'} Jun 14 18:34:44.311385 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:34:44.311385 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:34:44.311385 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:34:44.311385 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:34:44.311385 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:34:44.311385 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:34:44.311385 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:34:44.311385 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:34:44.311385 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:34:44.311385 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:34:44.311385 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2876875b-5dbe-4032-949a-3357292296a2 could not be found. Jun 14 18:34:44.311385 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:34:44.311385 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:34:44.311385 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:34:44.311385 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:34:44.311385 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:34:44.311385 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:34:44.311385 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:34:44.311385 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:34:44.311385 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:34:44.313507 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:34:44.313507 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 14 18:34:44.313507 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 14 18:34:44.313507 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 14 18:34:44.313507 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 14 18:34:44.313507 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:34:44.313507 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:34:44.313507 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:34:44.313507 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:34:44.313507 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2876875b-5dbe-4032-949a-3357292296a2 could not be found. Jun 14 18:34:44.313507 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:34:44.313507 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:34:44.313507 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:34:44.313507 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:34:44.313507 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:34:44.313507 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:34:44.313507 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:34:44.313507 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:34:44.313507 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2876875b-5dbe-4032-949a-3357292296a2 could not be found. Jun 14 18:34:44.313507 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:34:44.315195 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-a97e9184-1e90-4ec2-82bc-85181f35ed06 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Returning 404 to user: Instance 2876875b-5dbe-4032-949a-3357292296a2 could not be found. {{(pid=118623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:34:44.315195 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-a97e9184-1e90-4ec2-82bc-85181f35ed06 tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 404 len: 111 microversion: 2.20 time: 0.030103 Jun 14 18:34:44.315195 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 448/917] 10.222.0.78 () {60 vars in 1279 bytes} [Tue Jun 14 18:34:44 2022] DELETE /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 14 18:34:44.319510 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-7470af35-504c-44fa-af03-70915953055a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:34:44.320119 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-7470af35-504c-44fa-af03-70915953055a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] [instance: 2876875b-5dbe-4032-949a-3357292296a2] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:34:44.326539 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7470af35-504c-44fa-af03-70915953055a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:34:44.326989 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7470af35-504c-44fa-af03-70915953055a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:34:44.328397 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7470af35-504c-44fa-af03-70915953055a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:34:44.328828 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7470af35-504c-44fa-af03-70915953055a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:34:44.341807 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.wsgi [None req-7470af35-504c-44fa-af03-70915953055a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] HTTP exception thrown: Instance 2876875b-5dbe-4032-949a-3357292296a2 could not be found. Jun 14 18:34:44.343376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-7470af35-504c-44fa-af03-70915953055a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Request method failure captured: Jun 14 18:34:44.343376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: request: GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 HTTP/1.1 Jun 14 18:34:44.343376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept: application/json Jun 14 18:34:44.343376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept-Encoding: identity Jun 14 18:34:44.343376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Connection: close Jun 14 18:34:44.343376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Length: 0 Jun 14 18:34:44.343376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Type: application/json Jun 14 18:34:44.343376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Host: 10.222.0.78 Jun 14 18:34:44.343376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Openstack-System-Scope: None Jun 14 18:34:44.343376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: User-Agent: python-urllib3/1.26.9 Jun 14 18:34:44.343376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Auth-Token: gAAAAABiqNMFJuicSA_x3LAwtlTtL0woYIYWPVyzRBuu2w3gIFz8zwkFCJVgYXMmymY6Og8Q-JCquDKlggQ9BBzvZMZGA1Cg_iP1ACfiqqk9tEBoFtdzgUZok99MmOP28xoQ8P2eYjOVjHuIg3g70dWaiW6WYAMhzP1q7mnjqOrn3stEWOIBfsk Jun 14 18:34:44.343376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Id: None Jun 14 18:34:44.343376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Name: None Jun 14 18:34:44.343376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Identity-Status: Confirmed Jun 14 18:34:44.343376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Is-Admin-Project: True Jun 14 18:34:44.343376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Openstack-Nova-Api-Version: 2.20 Jun 14 18:34:44.343376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Id: default Jun 14 18:34:44.343376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Name: Default Jun 14 18:34:44.343376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Id: e8603a3b1604479da86224c52c2467ad Jun 14 18:34:44.343376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-993386760 Jun 14 18:34:44.343376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Role: reader,member Jun 14 18:34:44.343376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Roles: reader,member Jun 14 18:34:44.344914 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e8603a3b1604479da86224c52c2467ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e8603a3b1604479da86224c52c2467ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e8603a3b1604479da86224c52c2467ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e8603a3b1604479da86224c52c2467ad"}]}] Jun 14 18:34:44.344914 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant: tempest-AttachVolumeShelveTestJSON-993386760 Jun 14 18:34:44.344914 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Id: e8603a3b1604479da86224c52c2467ad Jun 14 18:34:44.344914 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-993386760 Jun 14 18:34:44.344914 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User: tempest-AttachVolumeShelveTestJSON-993386760-project Jun 14 18:34:44.344914 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Id: default Jun 14 18:34:44.344914 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Name: Default Jun 14 18:34:44.344914 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Id: 76baaf45903d4c53ab3e0fe459b228ea Jun 14 18:34:44.344914 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Name: tempest-AttachVolumeShelveTestJSON-993386760-project Jun 14 18:34:44.344914 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: method: > Jun 14 18:34:44.344914 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: exception: Instance 2876875b-5dbe-4032-949a-3357292296a2 could not be found. Jun 14 18:34:44.344914 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: action_args: {'id': '2876875b-5dbe-4032-949a-3357292296a2'} Jun 14 18:34:44.345800 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:34:44.345800 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:34:44.345800 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:34:44.345800 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:34:44.345800 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:34:44.345800 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:34:44.345800 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:34:44.345800 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:34:44.345800 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:34:44.345800 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:34:44.345800 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2876875b-5dbe-4032-949a-3357292296a2 could not be found. Jun 14 18:34:44.345800 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:34:44.345800 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:34:44.345800 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:34:44.345800 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:34:44.345800 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:34:44.345800 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:34:44.345800 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:34:44.345800 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:34:44.345800 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:34:44.347207 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:34:44.347207 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:34:44.347207 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:34:44.347207 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:34:44.347207 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:34:44.347207 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:34:44.347207 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:34:44.347207 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2876875b-5dbe-4032-949a-3357292296a2 could not be found. Jun 14 18:34:44.347207 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:34:44.347207 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:34:44.347207 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:34:44.347207 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:34:44.347207 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:34:44.347207 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:34:44.347207 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:34:44.347207 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:34:44.347207 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2876875b-5dbe-4032-949a-3357292296a2 could not be found. Jun 14 18:34:44.347207 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:34:44.348530 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-7470af35-504c-44fa-af03-70915953055a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] Returning 404 to user: Instance 2876875b-5dbe-4032-949a-3357292296a2 could not be found. {{(pid=118624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:34:44.348530 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-7470af35-504c-44fa-af03-70915953055a tempest-AttachVolumeShelveTestJSON-993386760 tempest-AttachVolumeShelveTestJSON-993386760-project] 10.222.0.78 "GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2" status: 404 len: 111 microversion: 2.20 time: 0.029190 Jun 14 18:34:44.348530 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 470/918] 10.222.0.78 () {60 vars in 1276 bytes} [Tue Jun 14 18:34:44 2022] GET /compute/v2.1/servers/2876875b-5dbe-4032-949a-3357292296a2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 14 18:34:48.443038 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-fab3dcce-252b-4106-90da-b21a865c49ea tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:34:48.446580 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-fab3dcce-252b-4106-90da-b21a865c49ea tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:34:48.450354 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-fab3dcce-252b-4106-90da-b21a865c49ea tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:34:48.451021 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-fab3dcce-252b-4106-90da-b21a865c49ea tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:34:48.452104 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-fab3dcce-252b-4106-90da-b21a865c49ea tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:34:48.452324 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-fab3dcce-252b-4106-90da-b21a865c49ea tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:34:48.475837 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-fab3dcce-252b-4106-90da-b21a865c49ea tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1/ips" status: 200 len: 148 microversion: 2.1 time: 0.036642 Jun 14 18:34:48.476478 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 449/919] 10.222.0.78 () {58 vars in 1247 bytes} [Tue Jun 14 18:34:48 2022] GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1/ips => generated 148 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:34:50.095717 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-43a7834c-ce84-4510-be69-fb4bc31e5f82 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6f34137-0c03-4d1d-9b64-746cd4995acd"}} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:34:50.096862 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-43a7834c-ce84-4510-be69-fb4bc31e5f82 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:34:50.103522 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-43a7834c-ce84-4510-be69-fb4bc31e5f82 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:34:50.103970 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-43a7834c-ce84-4510-be69-fb4bc31e5f82 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:34:50.104738 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-43a7834c-ce84-4510-be69-fb4bc31e5f82 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:34:50.105173 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-43a7834c-ce84-4510-be69-fb4bc31e5f82 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:34:50.853677 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-43a7834c-ce84-4510-be69-fb4bc31e5f82 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "POST /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.762037 Jun 14 18:34:50.854532 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 471/920] 10.222.0.78 () {60 vars in 1322 bytes} [Tue Jun 14 18:34:50 2022] POST /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1/os-volume_attachments => generated 194 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:35:00.654393 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-533a6bd1-6184-4786-aec7-ec879bfdf1a3 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:00.654393 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-533a6bd1-6184-4786-aec7-ec879bfdf1a3 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:00.654393 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:35:00.655580 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:35:00.660576 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-533a6bd1-6184-4786-aec7-ec879bfdf1a3 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:00.661038 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-533a6bd1-6184-4786-aec7-ec879bfdf1a3 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:00.661913 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-533a6bd1-6184-4786-aec7-ec879bfdf1a3 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:00.662349 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-533a6bd1-6184-4786-aec7-ec879bfdf1a3 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:00.759875 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.objects.instance [None req-533a6bd1-6184-4786-aec7-ec879bfdf1a3 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lazy-loading 'services' on Instance uuid fed1dbeb-530d-4733-99c1-799e566bf8c1 {{(pid=118623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:35:00.986188 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-533a6bd1-6184-4786-aec7-ec879bfdf1a3 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "DELETE /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1/os-volume_attachments/b6f34137-0c03-4d1d-9b64-746cd4995acd" status: 202 len: 0 microversion: 2.1 time: 0.338835 Jun 14 18:35:00.986835 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 450/921] 10.222.0.78 () {58 vars in 1415 bytes} [Tue Jun 14 18:35:00 2022] DELETE /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1/os-volume_attachments/b6f34137-0c03-4d1d-9b64-746cd4995acd => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:35:00.996081 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-6d13ef96-b393-416e-8781-4c21fe8a5d09 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:00.998641 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-6d13ef96-b393-416e-8781-4c21fe8a5d09 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:01.001514 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:35:01.002460 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:35:01.008206 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6d13ef96-b393-416e-8781-4c21fe8a5d09 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:01.009083 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6d13ef96-b393-416e-8781-4c21fe8a5d09 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:01.010082 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6d13ef96-b393-416e-8781-4c21fe8a5d09 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:01.010691 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6d13ef96-b393-416e-8781-4c21fe8a5d09 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:01.043265 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-6d13ef96-b393-416e-8781-4c21fe8a5d09 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051619 Jun 14 18:35:01.044064 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 472/922] 10.222.0.78 () {58 vars in 1301 bytes} [Tue Jun 14 18:35:00 2022] GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:35:02.056947 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-ae0c2c88-471c-4f03-9d39-a96292808e38 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:02.057965 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-ae0c2c88-471c-4f03-9d39-a96292808e38 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:02.064641 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ae0c2c88-471c-4f03-9d39-a96292808e38 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:02.065135 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ae0c2c88-471c-4f03-9d39-a96292808e38 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:02.065939 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ae0c2c88-471c-4f03-9d39-a96292808e38 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:02.066378 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ae0c2c88-471c-4f03-9d39-a96292808e38 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:02.097498 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-ae0c2c88-471c-4f03-9d39-a96292808e38 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045896 Jun 14 18:35:02.098070 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 451/923] 10.222.0.78 () {58 vars in 1301 bytes} [Tue Jun 14 18:35:02 2022] GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:35:03.111074 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-9fa4ea5a-037e-4307-847a-fcfb4a637aeb tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:03.111961 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-9fa4ea5a-037e-4307-847a-fcfb4a637aeb tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:03.119652 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9fa4ea5a-037e-4307-847a-fcfb4a637aeb tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:03.120102 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9fa4ea5a-037e-4307-847a-fcfb4a637aeb tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:03.120880 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9fa4ea5a-037e-4307-847a-fcfb4a637aeb tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:03.121317 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9fa4ea5a-037e-4307-847a-fcfb4a637aeb tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:03.156237 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-9fa4ea5a-037e-4307-847a-fcfb4a637aeb tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050942 Jun 14 18:35:03.157200 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 473/924] 10.222.0.78 () {58 vars in 1301 bytes} [Tue Jun 14 18:35:03 2022] GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:35:04.169613 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-a0ca939d-944a-460b-acee-e3afdbe1bd07 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:04.170532 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-a0ca939d-944a-460b-acee-e3afdbe1bd07 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:04.177249 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a0ca939d-944a-460b-acee-e3afdbe1bd07 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:04.177784 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a0ca939d-944a-460b-acee-e3afdbe1bd07 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:04.178483 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a0ca939d-944a-460b-acee-e3afdbe1bd07 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:04.178914 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a0ca939d-944a-460b-acee-e3afdbe1bd07 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:04.213019 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-a0ca939d-944a-460b-acee-e3afdbe1bd07 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047579 Jun 14 18:35:04.213644 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 452/925] 10.222.0.78 () {58 vars in 1301 bytes} [Tue Jun 14 18:35:04 2022] GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:35:05.226077 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-62c86b16-76a8-4289-88ad-69bcf780815e tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:05.226937 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-62c86b16-76a8-4289-88ad-69bcf780815e tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:05.236678 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-62c86b16-76a8-4289-88ad-69bcf780815e tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:05.237117 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-62c86b16-76a8-4289-88ad-69bcf780815e tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:05.238042 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-62c86b16-76a8-4289-88ad-69bcf780815e tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:05.238538 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-62c86b16-76a8-4289-88ad-69bcf780815e tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:05.268654 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-62c86b16-76a8-4289-88ad-69bcf780815e tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047799 Jun 14 18:35:05.269226 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 474/926] 10.222.0.78 () {58 vars in 1301 bytes} [Tue Jun 14 18:35:05 2022] GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 14 18:35:05.330139 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-cdeb9587-0629-4420-b891-94046540fa32 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:05.330634 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-cdeb9587-0629-4420-b891-94046540fa32 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:05.337176 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-cdeb9587-0629-4420-b891-94046540fa32 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:05.337664 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-cdeb9587-0629-4420-b891-94046540fa32 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:05.338514 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-cdeb9587-0629-4420-b891-94046540fa32 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:05.338983 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-cdeb9587-0629-4420-b891-94046540fa32 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:05.367931 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-cdeb9587-0629-4420-b891-94046540fa32 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] Going to try to terminate instance {{(pid=118623) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:35:05.660181 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-cdeb9587-0629-4420-b891-94046540fa32 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "DELETE /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1" status: 204 len: 0 microversion: 2.1 time: 0.333525 Jun 14 18:35:05.660818 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 453/927] 10.222.0.78 () {58 vars in 1238 bytes} [Tue Jun 14 18:35:05 2022] DELETE /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 18:35:05.669878 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-5cf7ba5a-2c82-497e-a68a-34e3e6ae5102 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:05.670735 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-5cf7ba5a-2c82-497e-a68a-34e3e6ae5102 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:05.677230 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5cf7ba5a-2c82-497e-a68a-34e3e6ae5102 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:05.677709 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5cf7ba5a-2c82-497e-a68a-34e3e6ae5102 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:05.678466 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5cf7ba5a-2c82-497e-a68a-34e3e6ae5102 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:05.678898 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5cf7ba5a-2c82-497e-a68a-34e3e6ae5102 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:05.837315 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-5cf7ba5a-2c82-497e-a68a-34e3e6ae5102 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:35:05.845734 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-5cf7ba5a-2c82-497e-a68a-34e3e6ae5102 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1" status: 200 len: 1676 microversion: 2.1 time: 0.180158 Jun 14 18:35:05.846326 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 475/928] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:05 2022] GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1 => generated 1676 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:35:06.864957 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-e04b6dc5-522e-4b5b-8fcd-423799e67213 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:06.865876 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-e04b6dc5-522e-4b5b-8fcd-423799e67213 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:06.873630 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e04b6dc5-522e-4b5b-8fcd-423799e67213 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:06.874281 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e04b6dc5-522e-4b5b-8fcd-423799e67213 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:06.875074 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e04b6dc5-522e-4b5b-8fcd-423799e67213 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:06.875552 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e04b6dc5-522e-4b5b-8fcd-423799e67213 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:07.064173 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-e04b6dc5-522e-4b5b-8fcd-423799e67213 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:35:07.070601 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-e04b6dc5-522e-4b5b-8fcd-423799e67213 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1" status: 200 len: 1676 microversion: 2.1 time: 0.210636 Jun 14 18:35:07.071170 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 454/929] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:06 2022] GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1 => generated 1676 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:35:08.089286 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-40f13eba-d957-4ba0-8067-61e1356acabc tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:08.090703 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-40f13eba-d957-4ba0-8067-61e1356acabc tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:08.099073 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-40f13eba-d957-4ba0-8067-61e1356acabc tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:08.099941 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-40f13eba-d957-4ba0-8067-61e1356acabc tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:08.100982 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-40f13eba-d957-4ba0-8067-61e1356acabc tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:08.101692 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-40f13eba-d957-4ba0-8067-61e1356acabc tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:08.203446 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-40f13eba-d957-4ba0-8067-61e1356acabc tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:35:08.212863 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-40f13eba-d957-4ba0-8067-61e1356acabc tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1" status: 200 len: 1609 microversion: 2.1 time: 0.128123 Jun 14 18:35:08.214584 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 476/930] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:08 2022] GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1 => generated 1609 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:35:08.452639 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-045658e5-f320-4dd2-a220-f91bc4c97521 req-a92dd57c-7fae-4a6a-aabe-c134e067a67d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fed1dbeb-530d-4733-99c1-799e566bf8c1", "name": "network-vif-deleted", "tag": "9a82f6b0-da2d-418b-9d02-f617bd45eb15"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:35:08.462724 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-045658e5-f320-4dd2-a220-f91bc4c97521 req-a92dd57c-7fae-4a6a-aabe-c134e067a67d service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:08.463161 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-045658e5-f320-4dd2-a220-f91bc4c97521 req-a92dd57c-7fae-4a6a-aabe-c134e067a67d service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:08.476168 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-045658e5-f320-4dd2-a220-f91bc4c97521 req-a92dd57c-7fae-4a6a-aabe-c134e067a67d service nova] Creating event network-vif-deleted:9a82f6b0-da2d-418b-9d02-f617bd45eb15 for instance fed1dbeb-530d-4733-99c1-799e566bf8c1 on hv-cinder-84456 Jun 14 18:35:08.481184 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-045658e5-f320-4dd2-a220-f91bc4c97521 req-a92dd57c-7fae-4a6a-aabe-c134e067a67d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033481 Jun 14 18:35:08.482121 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 455/931] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:35:09.239358 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-9aefcdf9-cb12-4436-ac56-65c8080367f7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:09.239979 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-9aefcdf9-cb12-4436-ac56-65c8080367f7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:09.252433 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9aefcdf9-cb12-4436-ac56-65c8080367f7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:09.253912 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9aefcdf9-cb12-4436-ac56-65c8080367f7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:09.255661 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9aefcdf9-cb12-4436-ac56-65c8080367f7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:09.256115 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9aefcdf9-cb12-4436-ac56-65c8080367f7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:09.296073 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9aefcdf9-cb12-4436-ac56-65c8080367f7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:09.296073 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9aefcdf9-cb12-4436-ac56-65c8080367f7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:09.296073 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.objects.instance [None req-9aefcdf9-cb12-4436-ac56-65c8080367f7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lazy-loading 'fault' on Instance uuid fed1dbeb-530d-4733-99c1-799e566bf8c1 {{(pid=118624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:35:09.343027 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-9aefcdf9-cb12-4436-ac56-65c8080367f7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9254bd46822346009497b01d28314335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f8367a52044e82a2c272da39e1bfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:35:09.358381 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-9aefcdf9-cb12-4436-ac56-65c8080367f7 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1" status: 200 len: 1328 microversion: 2.1 time: 0.128265 Jun 14 18:35:09.359249 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 477/932] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:09 2022] GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1 => generated 1328 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:35:10.388778 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-88afc7cf-7f69-4e77-89ce-880744dcfb20 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:10.390213 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-88afc7cf-7f69-4e77-89ce-880744dcfb20 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:10.402886 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-88afc7cf-7f69-4e77-89ce-880744dcfb20 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:10.403811 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-88afc7cf-7f69-4e77-89ce-880744dcfb20 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:10.405662 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-88afc7cf-7f69-4e77-89ce-880744dcfb20 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:10.406452 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-88afc7cf-7f69-4e77-89ce-880744dcfb20 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:10.428500 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.wsgi [None req-88afc7cf-7f69-4e77-89ce-880744dcfb20 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] HTTP exception thrown: Instance fed1dbeb-530d-4733-99c1-799e566bf8c1 could not be found. Jun 14 18:35:10.430209 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-88afc7cf-7f69-4e77-89ce-880744dcfb20 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Request method failure captured: Jun 14 18:35:10.430209 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: request: GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1 HTTP/1.1 Jun 14 18:35:10.430209 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept: application/json Jun 14 18:35:10.430209 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept-Encoding: identity Jun 14 18:35:10.430209 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Connection: close Jun 14 18:35:10.430209 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Length: 0 Jun 14 18:35:10.430209 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Type: application/json Jun 14 18:35:10.430209 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Host: 10.222.0.78 Jun 14 18:35:10.430209 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Openstack-System-Scope: None Jun 14 18:35:10.430209 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: User-Agent: python-urllib3/1.26.9 Jun 14 18:35:10.430209 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Auth-Token: gAAAAABiqNNRwUW-ILUkPK_wgILFSFKwt3erUOv38mYIB0oCeDDiotO112_xIQykQF206CMg3446rqZisR6hzfab3579MeUncL30z5LdS-2pD1weLSQ2dqyxdVYPdVwx-jGbuP7Kwf2vbYNW1CdwMR0V5q1_4RRQAdNuD7UVUw8E8v9L5saJIsU Jun 14 18:35:10.430209 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Id: None Jun 14 18:35:10.430209 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Name: None Jun 14 18:35:10.430209 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Identity-Status: Confirmed Jun 14 18:35:10.430209 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Is-Admin-Project: True Jun 14 18:35:10.430209 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Id: default Jun 14 18:35:10.430209 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Name: Default Jun 14 18:35:10.430209 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Id: 56f8367a52044e82a2c272da39e1bfd8 Jun 14 18:35:10.430209 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Name: tempest-AttachVolumeNegativeTest-1598181014 Jun 14 18:35:10.430209 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Role: reader,member Jun 14 18:35:10.430209 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Roles: reader,member Jun 14 18:35:10.431944 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_56f8367a52044e82a2c272da39e1bfd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/56f8367a52044e82a2c272da39e1bfd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/56f8367a52044e82a2c272da39e1bfd8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/56f8367a52044e82a2c272da39e1bfd8"}]}] Jun 14 18:35:10.431944 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant: tempest-AttachVolumeNegativeTest-1598181014 Jun 14 18:35:10.431944 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Id: 56f8367a52044e82a2c272da39e1bfd8 Jun 14 18:35:10.431944 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1598181014 Jun 14 18:35:10.431944 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User: tempest-AttachVolumeNegativeTest-1598181014-project Jun 14 18:35:10.431944 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Id: default Jun 14 18:35:10.431944 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Name: Default Jun 14 18:35:10.431944 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Id: 9254bd46822346009497b01d28314335 Jun 14 18:35:10.431944 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Name: tempest-AttachVolumeNegativeTest-1598181014-project Jun 14 18:35:10.431944 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: method: > Jun 14 18:35:10.431944 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: exception: Instance fed1dbeb-530d-4733-99c1-799e566bf8c1 could not be found. Jun 14 18:35:10.431944 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: action_args: {'id': 'fed1dbeb-530d-4733-99c1-799e566bf8c1'} Jun 14 18:35:10.432940 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:35:10.432940 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:10.432940 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:35:10.432940 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:35:10.432940 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:35:10.432940 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:35:10.432940 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:35:10.432940 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:35:10.432940 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:35:10.432940 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:35:10.432940 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fed1dbeb-530d-4733-99c1-799e566bf8c1 could not be found. Jun 14 18:35:10.432940 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:10.432940 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:35:10.432940 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:10.432940 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:10.432940 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:35:10.432940 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:35:10.432940 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:35:10.432940 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:35:10.432940 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:35:10.435826 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:35:10.435826 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:35:10.435826 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:35:10.435826 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:35:10.435826 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:35:10.435826 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:35:10.435826 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:35:10.435826 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fed1dbeb-530d-4733-99c1-799e566bf8c1 could not be found. Jun 14 18:35:10.435826 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:10.435826 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:35:10.435826 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:10.435826 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:10.435826 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:35:10.435826 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:35:10.435826 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:35:10.435826 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:35:10.435826 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fed1dbeb-530d-4733-99c1-799e566bf8c1 could not be found. Jun 14 18:35:10.435826 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:10.437847 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-88afc7cf-7f69-4e77-89ce-880744dcfb20 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Returning 404 to user: Instance fed1dbeb-530d-4733-99c1-799e566bf8c1 could not be found. {{(pid=118623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:35:10.437847 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-88afc7cf-7f69-4e77-89ce-880744dcfb20 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1" status: 404 len: 111 microversion: 2.1 time: 0.052529 Jun 14 18:35:10.437847 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 456/933] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:10 2022] GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:35:10.441371 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-36b9fa61-1c57-4f57-a22c-faa94b961c82 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '.version_select at 0x7efe704da5e0>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:10.550684 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-36b9fa61-1c57-4f57-a22c-faa94b961c82 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-48154676" status: 202 len: 0 microversion: 2.1 time: 0.113123 Jun 14 18:35:10.551434 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 478/934] 10.222.0.78 () {58 vars in 1214 bytes} [Tue Jun 14 18:35:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-48154676 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:35:13.758490 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-b408c55d-77f8-4fec-9cc7-5a294f662a1b tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:13.760212 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-b408c55d-77f8-4fec-9cc7-5a294f662a1b tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:13.772935 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b408c55d-77f8-4fec-9cc7-5a294f662a1b tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:13.773799 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b408c55d-77f8-4fec-9cc7-5a294f662a1b tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:13.775227 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b408c55d-77f8-4fec-9cc7-5a294f662a1b tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:13.776023 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b408c55d-77f8-4fec-9cc7-5a294f662a1b tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:13.801782 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.wsgi [None req-b408c55d-77f8-4fec-9cc7-5a294f662a1b tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] HTTP exception thrown: Instance fed1dbeb-530d-4733-99c1-799e566bf8c1 could not be found. Jun 14 18:35:13.804228 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-b408c55d-77f8-4fec-9cc7-5a294f662a1b tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Request method failure captured: Jun 14 18:35:13.804228 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: request: DELETE /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1 HTTP/1.1 Jun 14 18:35:13.804228 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept: application/json Jun 14 18:35:13.804228 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept-Encoding: identity Jun 14 18:35:13.804228 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Connection: close Jun 14 18:35:13.804228 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Length: 0 Jun 14 18:35:13.804228 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Type: application/json Jun 14 18:35:13.804228 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Host: 10.222.0.78 Jun 14 18:35:13.804228 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Openstack-System-Scope: None Jun 14 18:35:13.804228 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: User-Agent: python-urllib3/1.26.9 Jun 14 18:35:13.804228 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Auth-Token: gAAAAABiqNNRwUW-ILUkPK_wgILFSFKwt3erUOv38mYIB0oCeDDiotO112_xIQykQF206CMg3446rqZisR6hzfab3579MeUncL30z5LdS-2pD1weLSQ2dqyxdVYPdVwx-jGbuP7Kwf2vbYNW1CdwMR0V5q1_4RRQAdNuD7UVUw8E8v9L5saJIsU Jun 14 18:35:13.804228 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Id: None Jun 14 18:35:13.804228 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Name: None Jun 14 18:35:13.804228 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Identity-Status: Confirmed Jun 14 18:35:13.804228 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Is-Admin-Project: True Jun 14 18:35:13.804228 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Id: default Jun 14 18:35:13.804228 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Name: Default Jun 14 18:35:13.804228 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Id: 56f8367a52044e82a2c272da39e1bfd8 Jun 14 18:35:13.804228 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Name: tempest-AttachVolumeNegativeTest-1598181014 Jun 14 18:35:13.804228 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Role: reader,member Jun 14 18:35:13.804228 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Roles: reader,member Jun 14 18:35:13.807207 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_56f8367a52044e82a2c272da39e1bfd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/56f8367a52044e82a2c272da39e1bfd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/56f8367a52044e82a2c272da39e1bfd8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/56f8367a52044e82a2c272da39e1bfd8"}]}] Jun 14 18:35:13.807207 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant: tempest-AttachVolumeNegativeTest-1598181014 Jun 14 18:35:13.807207 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Id: 56f8367a52044e82a2c272da39e1bfd8 Jun 14 18:35:13.807207 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1598181014 Jun 14 18:35:13.807207 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User: tempest-AttachVolumeNegativeTest-1598181014-project Jun 14 18:35:13.807207 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Id: default Jun 14 18:35:13.807207 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Name: Default Jun 14 18:35:13.807207 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Id: 9254bd46822346009497b01d28314335 Jun 14 18:35:13.807207 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Name: tempest-AttachVolumeNegativeTest-1598181014-project Jun 14 18:35:13.807207 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: method: > Jun 14 18:35:13.807207 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: exception: Instance fed1dbeb-530d-4733-99c1-799e566bf8c1 could not be found. Jun 14 18:35:13.807207 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: action_args: {'id': 'fed1dbeb-530d-4733-99c1-799e566bf8c1'} Jun 14 18:35:13.809401 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:35:13.809401 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:13.809401 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:35:13.809401 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:35:13.809401 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:35:13.809401 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:35:13.809401 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:35:13.809401 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:35:13.809401 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:35:13.809401 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:35:13.809401 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fed1dbeb-530d-4733-99c1-799e566bf8c1 could not be found. Jun 14 18:35:13.809401 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:13.809401 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:35:13.809401 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:13.809401 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:13.809401 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:35:13.809401 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:35:13.809401 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:35:13.809401 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:35:13.809401 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:35:13.812166 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:35:13.812166 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 14 18:35:13.812166 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 14 18:35:13.812166 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 14 18:35:13.812166 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 14 18:35:13.812166 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:35:13.812166 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:35:13.812166 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:35:13.812166 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:35:13.812166 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fed1dbeb-530d-4733-99c1-799e566bf8c1 could not be found. Jun 14 18:35:13.812166 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:13.812166 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:35:13.812166 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:13.812166 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:13.812166 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:35:13.812166 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:35:13.812166 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:35:13.812166 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:35:13.812166 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fed1dbeb-530d-4733-99c1-799e566bf8c1 could not be found. Jun 14 18:35:13.812166 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:13.817033 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-b408c55d-77f8-4fec-9cc7-5a294f662a1b tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Returning 404 to user: Instance fed1dbeb-530d-4733-99c1-799e566bf8c1 could not be found. {{(pid=118623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:35:13.817033 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-b408c55d-77f8-4fec-9cc7-5a294f662a1b tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "DELETE /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1" status: 404 len: 111 microversion: 2.1 time: 0.055053 Jun 14 18:35:13.817033 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 457/935] 10.222.0.78 () {58 vars in 1238 bytes} [Tue Jun 14 18:35:13 2022] DELETE /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:35:13.825816 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-fc4e1772-1ad8-4ba0-b067-735206e28de4 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:13.827120 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-fc4e1772-1ad8-4ba0-b067-735206e28de4 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: fed1dbeb-530d-4733-99c1-799e566bf8c1] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:13.842247 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-fc4e1772-1ad8-4ba0-b067-735206e28de4 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:13.845917 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-fc4e1772-1ad8-4ba0-b067-735206e28de4 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:13.845917 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-fc4e1772-1ad8-4ba0-b067-735206e28de4 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:13.845917 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-fc4e1772-1ad8-4ba0-b067-735206e28de4 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:13.862744 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-b01952d3-c564-420f-8fb7-5c0b7a1fe8f5 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:13.866924 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-b01952d3-c564-420f-8fb7-5c0b7a1fe8f5 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:13.879733 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b01952d3-c564-420f-8fb7-5c0b7a1fe8f5 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:13.880569 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b01952d3-c564-420f-8fb7-5c0b7a1fe8f5 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:13.881606 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b01952d3-c564-420f-8fb7-5c0b7a1fe8f5 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:13.882218 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b01952d3-c564-420f-8fb7-5c0b7a1fe8f5 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:13.891630 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.wsgi [None req-fc4e1772-1ad8-4ba0-b067-735206e28de4 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] HTTP exception thrown: Instance fed1dbeb-530d-4733-99c1-799e566bf8c1 could not be found. Jun 14 18:35:13.895575 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-fc4e1772-1ad8-4ba0-b067-735206e28de4 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Request method failure captured: Jun 14 18:35:13.895575 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: request: GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1 HTTP/1.1 Jun 14 18:35:13.895575 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept: application/json Jun 14 18:35:13.895575 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept-Encoding: identity Jun 14 18:35:13.895575 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Connection: close Jun 14 18:35:13.895575 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Length: 0 Jun 14 18:35:13.895575 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Type: application/json Jun 14 18:35:13.895575 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Host: 10.222.0.78 Jun 14 18:35:13.895575 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Openstack-System-Scope: None Jun 14 18:35:13.895575 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: User-Agent: python-urllib3/1.26.9 Jun 14 18:35:13.895575 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Auth-Token: gAAAAABiqNNRwUW-ILUkPK_wgILFSFKwt3erUOv38mYIB0oCeDDiotO112_xIQykQF206CMg3446rqZisR6hzfab3579MeUncL30z5LdS-2pD1weLSQ2dqyxdVYPdVwx-jGbuP7Kwf2vbYNW1CdwMR0V5q1_4RRQAdNuD7UVUw8E8v9L5saJIsU Jun 14 18:35:13.895575 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Id: None Jun 14 18:35:13.895575 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Name: None Jun 14 18:35:13.895575 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Identity-Status: Confirmed Jun 14 18:35:13.895575 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Is-Admin-Project: True Jun 14 18:35:13.895575 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Id: default Jun 14 18:35:13.895575 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Name: Default Jun 14 18:35:13.895575 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Id: 56f8367a52044e82a2c272da39e1bfd8 Jun 14 18:35:13.895575 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Name: tempest-AttachVolumeNegativeTest-1598181014 Jun 14 18:35:13.895575 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Role: reader,member Jun 14 18:35:13.895575 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Roles: reader,member Jun 14 18:35:13.897233 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_56f8367a52044e82a2c272da39e1bfd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/56f8367a52044e82a2c272da39e1bfd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/56f8367a52044e82a2c272da39e1bfd8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/56f8367a52044e82a2c272da39e1bfd8"}]}] Jun 14 18:35:13.897233 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant: tempest-AttachVolumeNegativeTest-1598181014 Jun 14 18:35:13.897233 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Id: 56f8367a52044e82a2c272da39e1bfd8 Jun 14 18:35:13.897233 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1598181014 Jun 14 18:35:13.897233 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User: tempest-AttachVolumeNegativeTest-1598181014-project Jun 14 18:35:13.897233 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Id: default Jun 14 18:35:13.897233 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Name: Default Jun 14 18:35:13.897233 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Id: 9254bd46822346009497b01d28314335 Jun 14 18:35:13.897233 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Name: tempest-AttachVolumeNegativeTest-1598181014-project Jun 14 18:35:13.897233 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: method: > Jun 14 18:35:13.897233 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: exception: Instance fed1dbeb-530d-4733-99c1-799e566bf8c1 could not be found. Jun 14 18:35:13.897233 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: action_args: {'id': 'fed1dbeb-530d-4733-99c1-799e566bf8c1'} Jun 14 18:35:13.898210 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:35:13.898210 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:13.898210 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:35:13.898210 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:35:13.898210 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:35:13.898210 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:35:13.898210 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:35:13.898210 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:35:13.898210 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:35:13.898210 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:35:13.898210 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fed1dbeb-530d-4733-99c1-799e566bf8c1 could not be found. Jun 14 18:35:13.898210 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:35:13.898210 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:35:13.898210 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:35:13.898210 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:13.898210 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:35:13.898210 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:35:13.898210 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:35:13.898210 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:35:13.898210 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:35:13.899927 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:35:13.899927 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:35:13.899927 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:35:13.899927 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:35:13.899927 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:35:13.899927 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:35:13.899927 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:35:13.899927 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fed1dbeb-530d-4733-99c1-799e566bf8c1 could not be found. Jun 14 18:35:13.899927 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:35:13.899927 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:35:13.899927 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:35:13.899927 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:13.899927 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:35:13.899927 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:35:13.899927 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:35:13.899927 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:35:13.899927 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fed1dbeb-530d-4733-99c1-799e566bf8c1 could not be found. Jun 14 18:35:13.899927 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:35:13.901666 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-fc4e1772-1ad8-4ba0-b067-735206e28de4 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Returning 404 to user: Instance fed1dbeb-530d-4733-99c1-799e566bf8c1 could not be found. {{(pid=118624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:35:13.904022 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-fc4e1772-1ad8-4ba0-b067-735206e28de4 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1" status: 404 len: 111 microversion: 2.1 time: 0.088338 Jun 14 18:35:13.905367 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 479/936] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:13 2022] GET /compute/v2.1/servers/fed1dbeb-530d-4733-99c1-799e566bf8c1 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:35:13.922235 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-53f0ef5a-a0bd-4076-855f-7a0668a4d1ae req-bb3fb797-da36-4b0e-94eb-9b6c08a7f2d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "750a5111-2788-46b6-aa18-57f7c1019d64", "tag": "4fa1bac8-6b6d-4a62-afca-3aed68487621"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:35:13.944003 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-53f0ef5a-a0bd-4076-855f-7a0668a4d1ae req-bb3fb797-da36-4b0e-94eb-9b6c08a7f2d3 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:13.946692 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-53f0ef5a-a0bd-4076-855f-7a0668a4d1ae req-bb3fb797-da36-4b0e-94eb-9b6c08a7f2d3 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:13.970253 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-53f0ef5a-a0bd-4076-855f-7a0668a4d1ae req-bb3fb797-da36-4b0e-94eb-9b6c08a7f2d3 service nova] Creating event network-changed:4fa1bac8-6b6d-4a62-afca-3aed68487621 for instance 750a5111-2788-46b6-aa18-57f7c1019d64 on hv-cinder-84456 Jun 14 18:35:13.970604 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-b01952d3-c564-420f-8fb7-5c0b7a1fe8f5 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Going to try to terminate instance {{(pid=118623) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:35:13.988214 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-53f0ef5a-a0bd-4076-855f-7a0668a4d1ae req-bb3fb797-da36-4b0e-94eb-9b6c08a7f2d3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080721 Jun 14 18:35:13.997310 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 480/937] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:35:14.442818 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-b01952d3-c564-420f-8fb7-5c0b7a1fe8f5 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "DELETE /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 204 len: 0 microversion: 2.1 time: 0.587742 Jun 14 18:35:14.443760 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 458/938] 10.222.0.78 () {58 vars in 1238 bytes} [Tue Jun 14 18:35:13 2022] DELETE /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 18:35:14.453968 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-c567e6e5-a131-498a-8aad-024f2871395e tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:14.454890 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-c567e6e5-a131-498a-8aad-024f2871395e tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:14.461695 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c567e6e5-a131-498a-8aad-024f2871395e tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:14.462188 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c567e6e5-a131-498a-8aad-024f2871395e tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:14.462982 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c567e6e5-a131-498a-8aad-024f2871395e tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:14.463421 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c567e6e5-a131-498a-8aad-024f2871395e tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:14.657921 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-c567e6e5-a131-498a-8aad-024f2871395e tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:35:14.667800 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-c567e6e5-a131-498a-8aad-024f2871395e tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1569 microversion: 2.1 time: 0.219155 Jun 14 18:35:14.668852 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 481/939] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:14 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1569 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:35:15.294907 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-68d5b853-48c5-4414-89cf-a95225b59e4a tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:15.294907 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-68d5b853-48c5-4414-89cf-a95225b59e4a tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:15.303034 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-68d5b853-48c5-4414-89cf-a95225b59e4a tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:15.303572 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-68d5b853-48c5-4414-89cf-a95225b59e4a tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:15.304466 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-68d5b853-48c5-4414-89cf-a95225b59e4a tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:15.305221 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-68d5b853-48c5-4414-89cf-a95225b59e4a tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:15.322637 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.wsgi [None req-68d5b853-48c5-4414-89cf-a95225b59e4a tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] HTTP exception thrown: Instance 678e536c-8e80-49f6-90d0-72aec54c7c94 could not be found. Jun 14 18:35:15.324564 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-68d5b853-48c5-4414-89cf-a95225b59e4a tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Request method failure captured: Jun 14 18:35:15.324564 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: request: DELETE /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94 HTTP/1.1 Jun 14 18:35:15.324564 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept: application/json Jun 14 18:35:15.324564 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept-Encoding: identity Jun 14 18:35:15.324564 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Connection: close Jun 14 18:35:15.324564 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Length: 0 Jun 14 18:35:15.324564 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Type: application/json Jun 14 18:35:15.324564 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Host: 10.222.0.78 Jun 14 18:35:15.324564 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Openstack-System-Scope: None Jun 14 18:35:15.324564 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: User-Agent: python-urllib3/1.26.9 Jun 14 18:35:15.324564 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Auth-Token: gAAAAABiqNNRwUW-ILUkPK_wgILFSFKwt3erUOv38mYIB0oCeDDiotO112_xIQykQF206CMg3446rqZisR6hzfab3579MeUncL30z5LdS-2pD1weLSQ2dqyxdVYPdVwx-jGbuP7Kwf2vbYNW1CdwMR0V5q1_4RRQAdNuD7UVUw8E8v9L5saJIsU Jun 14 18:35:15.324564 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Id: None Jun 14 18:35:15.324564 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Name: None Jun 14 18:35:15.324564 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Identity-Status: Confirmed Jun 14 18:35:15.324564 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Is-Admin-Project: True Jun 14 18:35:15.324564 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Id: default Jun 14 18:35:15.324564 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Name: Default Jun 14 18:35:15.324564 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Id: 56f8367a52044e82a2c272da39e1bfd8 Jun 14 18:35:15.324564 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Name: tempest-AttachVolumeNegativeTest-1598181014 Jun 14 18:35:15.324564 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Role: reader,member Jun 14 18:35:15.324564 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Roles: reader,member Jun 14 18:35:15.331192 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_56f8367a52044e82a2c272da39e1bfd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/56f8367a52044e82a2c272da39e1bfd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/56f8367a52044e82a2c272da39e1bfd8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/56f8367a52044e82a2c272da39e1bfd8"}]}] Jun 14 18:35:15.331192 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant: tempest-AttachVolumeNegativeTest-1598181014 Jun 14 18:35:15.331192 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Id: 56f8367a52044e82a2c272da39e1bfd8 Jun 14 18:35:15.331192 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1598181014 Jun 14 18:35:15.331192 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User: tempest-AttachVolumeNegativeTest-1598181014-project Jun 14 18:35:15.331192 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Id: default Jun 14 18:35:15.331192 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Name: Default Jun 14 18:35:15.331192 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Id: 9254bd46822346009497b01d28314335 Jun 14 18:35:15.331192 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Name: tempest-AttachVolumeNegativeTest-1598181014-project Jun 14 18:35:15.331192 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: method: > Jun 14 18:35:15.331192 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: exception: Instance 678e536c-8e80-49f6-90d0-72aec54c7c94 could not be found. Jun 14 18:35:15.331192 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: action_args: {'id': '678e536c-8e80-49f6-90d0-72aec54c7c94'} Jun 14 18:35:15.333055 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:35:15.333055 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:15.333055 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:35:15.333055 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:35:15.333055 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:35:15.333055 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:35:15.333055 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:35:15.333055 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:35:15.333055 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:35:15.333055 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:35:15.333055 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 678e536c-8e80-49f6-90d0-72aec54c7c94 could not be found. Jun 14 18:35:15.333055 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:15.333055 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:35:15.333055 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:15.333055 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:15.333055 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:35:15.333055 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:35:15.333055 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:35:15.333055 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:35:15.333055 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:35:15.336452 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:35:15.336452 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 14 18:35:15.336452 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 14 18:35:15.336452 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 14 18:35:15.336452 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 14 18:35:15.336452 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:35:15.336452 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:35:15.336452 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:35:15.336452 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:35:15.336452 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 678e536c-8e80-49f6-90d0-72aec54c7c94 could not be found. Jun 14 18:35:15.336452 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:15.336452 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:35:15.336452 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:15.336452 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:15.336452 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:35:15.336452 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:35:15.336452 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:35:15.336452 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:35:15.336452 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 678e536c-8e80-49f6-90d0-72aec54c7c94 could not be found. Jun 14 18:35:15.336452 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:15.338342 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-68d5b853-48c5-4414-89cf-a95225b59e4a tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Returning 404 to user: Instance 678e536c-8e80-49f6-90d0-72aec54c7c94 could not be found. {{(pid=118623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:35:15.338342 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-68d5b853-48c5-4414-89cf-a95225b59e4a tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "DELETE /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94" status: 404 len: 111 microversion: 2.1 time: 0.037393 Jun 14 18:35:15.338342 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 459/940] 10.222.0.78 () {58 vars in 1238 bytes} [Tue Jun 14 18:35:15 2022] DELETE /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:35:15.338601 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-814da123-9358-4819-a77a-41195553a157 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:15.338601 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-814da123-9358-4819-a77a-41195553a157 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 678e536c-8e80-49f6-90d0-72aec54c7c94] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:15.343458 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-814da123-9358-4819-a77a-41195553a157 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:15.343913 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-814da123-9358-4819-a77a-41195553a157 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:15.344717 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-814da123-9358-4819-a77a-41195553a157 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:15.345166 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-814da123-9358-4819-a77a-41195553a157 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:15.363033 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.wsgi [None req-814da123-9358-4819-a77a-41195553a157 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] HTTP exception thrown: Instance 678e536c-8e80-49f6-90d0-72aec54c7c94 could not be found. Jun 14 18:35:15.365018 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-814da123-9358-4819-a77a-41195553a157 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Request method failure captured: Jun 14 18:35:15.365018 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: request: GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94 HTTP/1.1 Jun 14 18:35:15.365018 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept: application/json Jun 14 18:35:15.365018 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept-Encoding: identity Jun 14 18:35:15.365018 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Connection: close Jun 14 18:35:15.365018 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Length: 0 Jun 14 18:35:15.365018 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Type: application/json Jun 14 18:35:15.365018 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Host: 10.222.0.78 Jun 14 18:35:15.365018 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Openstack-System-Scope: None Jun 14 18:35:15.365018 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: User-Agent: python-urllib3/1.26.9 Jun 14 18:35:15.365018 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Auth-Token: gAAAAABiqNNRwUW-ILUkPK_wgILFSFKwt3erUOv38mYIB0oCeDDiotO112_xIQykQF206CMg3446rqZisR6hzfab3579MeUncL30z5LdS-2pD1weLSQ2dqyxdVYPdVwx-jGbuP7Kwf2vbYNW1CdwMR0V5q1_4RRQAdNuD7UVUw8E8v9L5saJIsU Jun 14 18:35:15.365018 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Id: None Jun 14 18:35:15.365018 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Name: None Jun 14 18:35:15.365018 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Identity-Status: Confirmed Jun 14 18:35:15.365018 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Is-Admin-Project: True Jun 14 18:35:15.365018 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Id: default Jun 14 18:35:15.365018 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Name: Default Jun 14 18:35:15.365018 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Id: 56f8367a52044e82a2c272da39e1bfd8 Jun 14 18:35:15.365018 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Name: tempest-AttachVolumeNegativeTest-1598181014 Jun 14 18:35:15.365018 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Role: reader,member Jun 14 18:35:15.365018 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Roles: reader,member Jun 14 18:35:15.368933 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_56f8367a52044e82a2c272da39e1bfd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/56f8367a52044e82a2c272da39e1bfd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/56f8367a52044e82a2c272da39e1bfd8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/56f8367a52044e82a2c272da39e1bfd8"}]}] Jun 14 18:35:15.368933 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant: tempest-AttachVolumeNegativeTest-1598181014 Jun 14 18:35:15.368933 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Id: 56f8367a52044e82a2c272da39e1bfd8 Jun 14 18:35:15.368933 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1598181014 Jun 14 18:35:15.368933 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User: tempest-AttachVolumeNegativeTest-1598181014-project Jun 14 18:35:15.368933 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Id: default Jun 14 18:35:15.368933 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Name: Default Jun 14 18:35:15.368933 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Id: 9254bd46822346009497b01d28314335 Jun 14 18:35:15.368933 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Name: tempest-AttachVolumeNegativeTest-1598181014-project Jun 14 18:35:15.368933 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: method: > Jun 14 18:35:15.368933 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: exception: Instance 678e536c-8e80-49f6-90d0-72aec54c7c94 could not be found. Jun 14 18:35:15.368933 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: action_args: {'id': '678e536c-8e80-49f6-90d0-72aec54c7c94'} Jun 14 18:35:15.369829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:35:15.369829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:15.369829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:35:15.369829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:35:15.369829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:35:15.369829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:35:15.369829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:35:15.369829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:35:15.369829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:35:15.369829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:35:15.369829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 678e536c-8e80-49f6-90d0-72aec54c7c94 could not be found. Jun 14 18:35:15.369829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:35:15.369829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:35:15.369829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:35:15.369829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:15.369829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:35:15.369829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:35:15.369829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:35:15.369829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:35:15.369829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:35:15.372376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:35:15.372376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:35:15.372376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:35:15.372376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:35:15.372376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:35:15.372376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:35:15.372376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:35:15.372376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 678e536c-8e80-49f6-90d0-72aec54c7c94 could not be found. Jun 14 18:35:15.372376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:35:15.372376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:35:15.372376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:35:15.372376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:15.372376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:35:15.372376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:35:15.372376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:35:15.372376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:35:15.372376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 678e536c-8e80-49f6-90d0-72aec54c7c94 could not be found. Jun 14 18:35:15.372376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:35:15.374020 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-814da123-9358-4819-a77a-41195553a157 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Returning 404 to user: Instance 678e536c-8e80-49f6-90d0-72aec54c7c94 could not be found. {{(pid=118624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:35:15.374020 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-814da123-9358-4819-a77a-41195553a157 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94" status: 404 len: 111 microversion: 2.1 time: 0.035341 Jun 14 18:35:15.374020 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 482/941] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:15 2022] GET /compute/v2.1/servers/678e536c-8e80-49f6-90d0-72aec54c7c94 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:35:15.376397 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-59494cd8-d0a2-4fd6-a5ff-fb7e73055ff0 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:15.376911 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-59494cd8-d0a2-4fd6-a5ff-fb7e73055ff0 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:15.383374 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-59494cd8-d0a2-4fd6-a5ff-fb7e73055ff0 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:15.383826 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-59494cd8-d0a2-4fd6-a5ff-fb7e73055ff0 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:15.384689 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-59494cd8-d0a2-4fd6-a5ff-fb7e73055ff0 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:15.385131 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-59494cd8-d0a2-4fd6-a5ff-fb7e73055ff0 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:15.400502 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.wsgi [None req-59494cd8-d0a2-4fd6-a5ff-fb7e73055ff0 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] HTTP exception thrown: Instance f1bbd826-8155-4a11-bba3-9a4b3172b726 could not be found. Jun 14 18:35:15.402155 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-59494cd8-d0a2-4fd6-a5ff-fb7e73055ff0 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Request method failure captured: Jun 14 18:35:15.402155 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: request: DELETE /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 HTTP/1.1 Jun 14 18:35:15.402155 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept: application/json Jun 14 18:35:15.402155 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept-Encoding: identity Jun 14 18:35:15.402155 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Connection: close Jun 14 18:35:15.402155 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Length: 0 Jun 14 18:35:15.402155 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Type: application/json Jun 14 18:35:15.402155 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Host: 10.222.0.78 Jun 14 18:35:15.402155 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Openstack-System-Scope: None Jun 14 18:35:15.402155 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: User-Agent: python-urllib3/1.26.9 Jun 14 18:35:15.402155 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Auth-Token: gAAAAABiqNNRwUW-ILUkPK_wgILFSFKwt3erUOv38mYIB0oCeDDiotO112_xIQykQF206CMg3446rqZisR6hzfab3579MeUncL30z5LdS-2pD1weLSQ2dqyxdVYPdVwx-jGbuP7Kwf2vbYNW1CdwMR0V5q1_4RRQAdNuD7UVUw8E8v9L5saJIsU Jun 14 18:35:15.402155 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Id: None Jun 14 18:35:15.402155 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Name: None Jun 14 18:35:15.402155 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Identity-Status: Confirmed Jun 14 18:35:15.402155 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Is-Admin-Project: True Jun 14 18:35:15.402155 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Id: default Jun 14 18:35:15.402155 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Name: Default Jun 14 18:35:15.402155 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Id: 56f8367a52044e82a2c272da39e1bfd8 Jun 14 18:35:15.402155 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Name: tempest-AttachVolumeNegativeTest-1598181014 Jun 14 18:35:15.402155 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Role: reader,member Jun 14 18:35:15.402155 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Roles: reader,member Jun 14 18:35:15.403933 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_56f8367a52044e82a2c272da39e1bfd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/56f8367a52044e82a2c272da39e1bfd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/56f8367a52044e82a2c272da39e1bfd8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/56f8367a52044e82a2c272da39e1bfd8"}]}] Jun 14 18:35:15.403933 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant: tempest-AttachVolumeNegativeTest-1598181014 Jun 14 18:35:15.403933 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Id: 56f8367a52044e82a2c272da39e1bfd8 Jun 14 18:35:15.403933 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1598181014 Jun 14 18:35:15.403933 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User: tempest-AttachVolumeNegativeTest-1598181014-project Jun 14 18:35:15.403933 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Id: default Jun 14 18:35:15.403933 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Name: Default Jun 14 18:35:15.403933 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Id: 9254bd46822346009497b01d28314335 Jun 14 18:35:15.403933 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Name: tempest-AttachVolumeNegativeTest-1598181014-project Jun 14 18:35:15.403933 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: method: > Jun 14 18:35:15.403933 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: exception: Instance f1bbd826-8155-4a11-bba3-9a4b3172b726 could not be found. Jun 14 18:35:15.403933 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: action_args: {'id': 'f1bbd826-8155-4a11-bba3-9a4b3172b726'} Jun 14 18:35:15.405120 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:35:15.405120 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:15.405120 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:35:15.405120 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:35:15.405120 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:35:15.405120 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:35:15.405120 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:35:15.405120 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:35:15.405120 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:35:15.405120 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:35:15.405120 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1bbd826-8155-4a11-bba3-9a4b3172b726 could not be found. Jun 14 18:35:15.405120 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:15.405120 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:35:15.405120 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:15.405120 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:15.405120 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:35:15.405120 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:35:15.405120 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:35:15.405120 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:35:15.405120 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:35:15.406458 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:35:15.406458 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 14 18:35:15.406458 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 14 18:35:15.406458 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 14 18:35:15.406458 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 14 18:35:15.406458 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:35:15.406458 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:35:15.406458 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:35:15.406458 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:35:15.406458 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1bbd826-8155-4a11-bba3-9a4b3172b726 could not be found. Jun 14 18:35:15.406458 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:15.406458 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:35:15.406458 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:15.406458 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:15.406458 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:35:15.406458 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:35:15.406458 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:35:15.406458 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:35:15.406458 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1bbd826-8155-4a11-bba3-9a4b3172b726 could not be found. Jun 14 18:35:15.406458 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:15.407732 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-59494cd8-d0a2-4fd6-a5ff-fb7e73055ff0 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Returning 404 to user: Instance f1bbd826-8155-4a11-bba3-9a4b3172b726 could not be found. {{(pid=118623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:35:15.407732 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-59494cd8-d0a2-4fd6-a5ff-fb7e73055ff0 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726" status: 404 len: 111 microversion: 2.1 time: 0.032413 Jun 14 18:35:15.407732 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 460/942] 10.222.0.78 () {58 vars in 1238 bytes} [Tue Jun 14 18:35:15 2022] DELETE /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 14 18:35:15.413134 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-9474d1cc-88bb-477a-be7f-8c52791a7616 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:15.413786 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-9474d1cc-88bb-477a-be7f-8c52791a7616 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: f1bbd826-8155-4a11-bba3-9a4b3172b726] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:15.422291 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9474d1cc-88bb-477a-be7f-8c52791a7616 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:15.422765 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9474d1cc-88bb-477a-be7f-8c52791a7616 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:15.423572 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9474d1cc-88bb-477a-be7f-8c52791a7616 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:15.424014 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9474d1cc-88bb-477a-be7f-8c52791a7616 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:15.440260 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.wsgi [None req-9474d1cc-88bb-477a-be7f-8c52791a7616 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] HTTP exception thrown: Instance f1bbd826-8155-4a11-bba3-9a4b3172b726 could not be found. Jun 14 18:35:15.442163 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-9474d1cc-88bb-477a-be7f-8c52791a7616 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Request method failure captured: Jun 14 18:35:15.442163 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: request: GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 HTTP/1.1 Jun 14 18:35:15.442163 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept: application/json Jun 14 18:35:15.442163 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept-Encoding: identity Jun 14 18:35:15.442163 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Connection: close Jun 14 18:35:15.442163 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Length: 0 Jun 14 18:35:15.442163 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Type: application/json Jun 14 18:35:15.442163 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Host: 10.222.0.78 Jun 14 18:35:15.442163 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Openstack-System-Scope: None Jun 14 18:35:15.442163 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: User-Agent: python-urllib3/1.26.9 Jun 14 18:35:15.442163 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Auth-Token: gAAAAABiqNNRwUW-ILUkPK_wgILFSFKwt3erUOv38mYIB0oCeDDiotO112_xIQykQF206CMg3446rqZisR6hzfab3579MeUncL30z5LdS-2pD1weLSQ2dqyxdVYPdVwx-jGbuP7Kwf2vbYNW1CdwMR0V5q1_4RRQAdNuD7UVUw8E8v9L5saJIsU Jun 14 18:35:15.442163 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Id: None Jun 14 18:35:15.442163 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Name: None Jun 14 18:35:15.442163 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Identity-Status: Confirmed Jun 14 18:35:15.442163 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Is-Admin-Project: True Jun 14 18:35:15.442163 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Id: default Jun 14 18:35:15.442163 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Name: Default Jun 14 18:35:15.442163 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Id: 56f8367a52044e82a2c272da39e1bfd8 Jun 14 18:35:15.442163 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Name: tempest-AttachVolumeNegativeTest-1598181014 Jun 14 18:35:15.442163 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Role: reader,member Jun 14 18:35:15.442163 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Roles: reader,member Jun 14 18:35:15.445270 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_56f8367a52044e82a2c272da39e1bfd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/56f8367a52044e82a2c272da39e1bfd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/56f8367a52044e82a2c272da39e1bfd8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/56f8367a52044e82a2c272da39e1bfd8"}]}] Jun 14 18:35:15.445270 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant: tempest-AttachVolumeNegativeTest-1598181014 Jun 14 18:35:15.445270 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Id: 56f8367a52044e82a2c272da39e1bfd8 Jun 14 18:35:15.445270 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1598181014 Jun 14 18:35:15.445270 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User: tempest-AttachVolumeNegativeTest-1598181014-project Jun 14 18:35:15.445270 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Id: default Jun 14 18:35:15.445270 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Name: Default Jun 14 18:35:15.445270 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Id: 9254bd46822346009497b01d28314335 Jun 14 18:35:15.445270 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Name: tempest-AttachVolumeNegativeTest-1598181014-project Jun 14 18:35:15.445270 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: method: > Jun 14 18:35:15.445270 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: exception: Instance f1bbd826-8155-4a11-bba3-9a4b3172b726 could not be found. Jun 14 18:35:15.445270 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: action_args: {'id': 'f1bbd826-8155-4a11-bba3-9a4b3172b726'} Jun 14 18:35:15.448301 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:35:15.448301 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:15.448301 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:35:15.448301 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:35:15.448301 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:35:15.448301 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:35:15.448301 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:35:15.448301 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:35:15.448301 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:35:15.448301 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:35:15.448301 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1bbd826-8155-4a11-bba3-9a4b3172b726 could not be found. Jun 14 18:35:15.448301 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:35:15.448301 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:35:15.448301 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:35:15.448301 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:15.448301 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:35:15.448301 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:35:15.448301 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:35:15.448301 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:35:15.448301 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:35:15.451049 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:35:15.451049 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:35:15.451049 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:35:15.451049 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:35:15.451049 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:35:15.451049 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:35:15.451049 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:35:15.451049 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1bbd826-8155-4a11-bba3-9a4b3172b726 could not be found. Jun 14 18:35:15.451049 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:35:15.451049 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:35:15.451049 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:35:15.451049 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:15.451049 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:35:15.451049 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:35:15.451049 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:35:15.451049 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:35:15.451049 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1bbd826-8155-4a11-bba3-9a4b3172b726 could not be found. Jun 14 18:35:15.451049 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:35:15.453370 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-9474d1cc-88bb-477a-be7f-8c52791a7616 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Returning 404 to user: Instance f1bbd826-8155-4a11-bba3-9a4b3172b726 could not be found. {{(pid=118624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:35:15.453370 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-9474d1cc-88bb-477a-be7f-8c52791a7616 tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726" status: 404 len: 111 microversion: 2.1 time: 0.034877 Jun 14 18:35:15.453370 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 483/943] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:15 2022] GET /compute/v2.1/servers/f1bbd826-8155-4a11-bba3-9a4b3172b726 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:35:15.713339 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-ca34aac5-45d8-445c-b8a4-a96e8b57e7fb tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:15.713999 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-ca34aac5-45d8-445c-b8a4-a96e8b57e7fb tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:15.721194 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ca34aac5-45d8-445c-b8a4-a96e8b57e7fb tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:15.721679 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ca34aac5-45d8-445c-b8a4-a96e8b57e7fb tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:15.722460 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ca34aac5-45d8-445c-b8a4-a96e8b57e7fb tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:15.722894 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ca34aac5-45d8-445c-b8a4-a96e8b57e7fb tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:15.923670 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-ca34aac5-45d8-445c-b8a4-a96e8b57e7fb tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:35:15.943503 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-ca34aac5-45d8-445c-b8a4-a96e8b57e7fb tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1569 microversion: 2.1 time: 0.250347 Jun 14 18:35:15.945878 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 461/944] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:15 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1569 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:35:16.648762 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-676dd57a-7859-4532-a8a5-2bdd82a1fe7f req-14605e9f-58fa-4d04-8cb1-cadab02dd38f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "750a5111-2788-46b6-aa18-57f7c1019d64", "name": "network-vif-deleted", "tag": "4fa1bac8-6b6d-4a62-afca-3aed68487621"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:35:16.658688 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-676dd57a-7859-4532-a8a5-2bdd82a1fe7f req-14605e9f-58fa-4d04-8cb1-cadab02dd38f service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:16.659122 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-676dd57a-7859-4532-a8a5-2bdd82a1fe7f req-14605e9f-58fa-4d04-8cb1-cadab02dd38f service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:16.674278 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-676dd57a-7859-4532-a8a5-2bdd82a1fe7f req-14605e9f-58fa-4d04-8cb1-cadab02dd38f service nova] Creating event network-vif-deleted:4fa1bac8-6b6d-4a62-afca-3aed68487621 for instance 750a5111-2788-46b6-aa18-57f7c1019d64 on hv-cinder-84456 Jun 14 18:35:16.679844 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-676dd57a-7859-4532-a8a5-2bdd82a1fe7f req-14605e9f-58fa-4d04-8cb1-cadab02dd38f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034516 Jun 14 18:35:16.680272 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 484/945] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:35:16.733233 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-bf1c7058-8410-45ec-b1a8-34022d0c8cbe tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:16.734031 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-bf1c7058-8410-45ec-b1a8-34022d0c8cbe tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 17641e09-70b6-4020-9fb5-31780056f2d9] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:16.740527 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-bf1c7058-8410-45ec-b1a8-34022d0c8cbe tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:16.740972 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-bf1c7058-8410-45ec-b1a8-34022d0c8cbe tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:16.741792 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-bf1c7058-8410-45ec-b1a8-34022d0c8cbe tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:16.742315 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-bf1c7058-8410-45ec-b1a8-34022d0c8cbe tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:16.757345 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.wsgi [None req-bf1c7058-8410-45ec-b1a8-34022d0c8cbe tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] HTTP exception thrown: Instance 17641e09-70b6-4020-9fb5-31780056f2d9 could not be found. Jun 14 18:35:16.759018 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-bf1c7058-8410-45ec-b1a8-34022d0c8cbe tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Request method failure captured: Jun 14 18:35:16.759018 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: request: DELETE /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9 HTTP/1.1 Jun 14 18:35:16.759018 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept: application/json Jun 14 18:35:16.759018 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept-Encoding: identity Jun 14 18:35:16.759018 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Connection: close Jun 14 18:35:16.759018 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Length: 0 Jun 14 18:35:16.759018 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Type: application/json Jun 14 18:35:16.759018 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Host: 10.222.0.78 Jun 14 18:35:16.759018 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Openstack-System-Scope: None Jun 14 18:35:16.759018 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: User-Agent: python-urllib3/1.26.9 Jun 14 18:35:16.759018 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Auth-Token: gAAAAABiqNNRwUW-ILUkPK_wgILFSFKwt3erUOv38mYIB0oCeDDiotO112_xIQykQF206CMg3446rqZisR6hzfab3579MeUncL30z5LdS-2pD1weLSQ2dqyxdVYPdVwx-jGbuP7Kwf2vbYNW1CdwMR0V5q1_4RRQAdNuD7UVUw8E8v9L5saJIsU Jun 14 18:35:16.759018 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Id: None Jun 14 18:35:16.759018 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Name: None Jun 14 18:35:16.759018 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Identity-Status: Confirmed Jun 14 18:35:16.759018 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Is-Admin-Project: True Jun 14 18:35:16.759018 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Id: default Jun 14 18:35:16.759018 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Name: Default Jun 14 18:35:16.759018 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Id: 56f8367a52044e82a2c272da39e1bfd8 Jun 14 18:35:16.759018 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Name: tempest-AttachVolumeNegativeTest-1598181014 Jun 14 18:35:16.759018 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Role: reader,member Jun 14 18:35:16.759018 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Roles: reader,member Jun 14 18:35:16.760566 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_56f8367a52044e82a2c272da39e1bfd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/56f8367a52044e82a2c272da39e1bfd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/56f8367a52044e82a2c272da39e1bfd8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/56f8367a52044e82a2c272da39e1bfd8"}]}] Jun 14 18:35:16.760566 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant: tempest-AttachVolumeNegativeTest-1598181014 Jun 14 18:35:16.760566 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Id: 56f8367a52044e82a2c272da39e1bfd8 Jun 14 18:35:16.760566 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1598181014 Jun 14 18:35:16.760566 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User: tempest-AttachVolumeNegativeTest-1598181014-project Jun 14 18:35:16.760566 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Id: default Jun 14 18:35:16.760566 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Name: Default Jun 14 18:35:16.760566 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Id: 9254bd46822346009497b01d28314335 Jun 14 18:35:16.760566 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Name: tempest-AttachVolumeNegativeTest-1598181014-project Jun 14 18:35:16.760566 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: method: > Jun 14 18:35:16.760566 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: exception: Instance 17641e09-70b6-4020-9fb5-31780056f2d9 could not be found. Jun 14 18:35:16.760566 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: action_args: {'id': '17641e09-70b6-4020-9fb5-31780056f2d9'} Jun 14 18:35:16.761493 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:35:16.761493 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:16.761493 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:35:16.761493 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:35:16.761493 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:35:16.761493 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:35:16.761493 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:35:16.761493 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:35:16.761493 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:35:16.761493 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:35:16.761493 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17641e09-70b6-4020-9fb5-31780056f2d9 could not be found. Jun 14 18:35:16.761493 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:16.761493 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:35:16.761493 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:16.761493 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:16.761493 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:35:16.761493 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:35:16.761493 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:35:16.761493 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:35:16.761493 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:35:16.763571 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:35:16.763571 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 14 18:35:16.763571 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 14 18:35:16.763571 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 14 18:35:16.763571 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 14 18:35:16.763571 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:35:16.763571 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:35:16.763571 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:35:16.763571 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:35:16.763571 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17641e09-70b6-4020-9fb5-31780056f2d9 could not be found. Jun 14 18:35:16.763571 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:16.763571 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:35:16.763571 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:16.763571 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:16.763571 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:35:16.763571 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:35:16.763571 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:35:16.763571 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:35:16.763571 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17641e09-70b6-4020-9fb5-31780056f2d9 could not be found. Jun 14 18:35:16.763571 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:16.768424 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-bf1c7058-8410-45ec-b1a8-34022d0c8cbe tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Returning 404 to user: Instance 17641e09-70b6-4020-9fb5-31780056f2d9 could not be found. {{(pid=118623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:35:16.768424 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-bf1c7058-8410-45ec-b1a8-34022d0c8cbe tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "DELETE /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9" status: 404 len: 111 microversion: 2.1 time: 0.032124 Jun 14 18:35:16.768424 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 462/946] 10.222.0.78 () {58 vars in 1238 bytes} [Tue Jun 14 18:35:16 2022] DELETE /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:35:16.774393 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-c5ca929a-f86f-4996-9813-3578614afa9f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:16.775096 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-c5ca929a-f86f-4996-9813-3578614afa9f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] [instance: 17641e09-70b6-4020-9fb5-31780056f2d9] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:16.784636 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c5ca929a-f86f-4996-9813-3578614afa9f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:16.785105 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c5ca929a-f86f-4996-9813-3578614afa9f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:16.786936 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c5ca929a-f86f-4996-9813-3578614afa9f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:16.786936 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c5ca929a-f86f-4996-9813-3578614afa9f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:16.802713 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.wsgi [None req-c5ca929a-f86f-4996-9813-3578614afa9f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] HTTP exception thrown: Instance 17641e09-70b6-4020-9fb5-31780056f2d9 could not be found. Jun 14 18:35:16.804389 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-c5ca929a-f86f-4996-9813-3578614afa9f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Request method failure captured: Jun 14 18:35:16.804389 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: request: GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9 HTTP/1.1 Jun 14 18:35:16.804389 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept: application/json Jun 14 18:35:16.804389 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept-Encoding: identity Jun 14 18:35:16.804389 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Connection: close Jun 14 18:35:16.804389 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Length: 0 Jun 14 18:35:16.804389 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Type: application/json Jun 14 18:35:16.804389 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Host: 10.222.0.78 Jun 14 18:35:16.804389 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Openstack-System-Scope: None Jun 14 18:35:16.804389 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: User-Agent: python-urllib3/1.26.9 Jun 14 18:35:16.804389 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Auth-Token: gAAAAABiqNNRwUW-ILUkPK_wgILFSFKwt3erUOv38mYIB0oCeDDiotO112_xIQykQF206CMg3446rqZisR6hzfab3579MeUncL30z5LdS-2pD1weLSQ2dqyxdVYPdVwx-jGbuP7Kwf2vbYNW1CdwMR0V5q1_4RRQAdNuD7UVUw8E8v9L5saJIsU Jun 14 18:35:16.804389 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Id: None Jun 14 18:35:16.804389 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Name: None Jun 14 18:35:16.804389 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Identity-Status: Confirmed Jun 14 18:35:16.804389 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Is-Admin-Project: True Jun 14 18:35:16.804389 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Id: default Jun 14 18:35:16.804389 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Name: Default Jun 14 18:35:16.804389 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Id: 56f8367a52044e82a2c272da39e1bfd8 Jun 14 18:35:16.804389 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Name: tempest-AttachVolumeNegativeTest-1598181014 Jun 14 18:35:16.804389 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Role: reader,member Jun 14 18:35:16.804389 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Roles: reader,member Jun 14 18:35:16.806534 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_56f8367a52044e82a2c272da39e1bfd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/56f8367a52044e82a2c272da39e1bfd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/56f8367a52044e82a2c272da39e1bfd8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/56f8367a52044e82a2c272da39e1bfd8"}]}] Jun 14 18:35:16.806534 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant: tempest-AttachVolumeNegativeTest-1598181014 Jun 14 18:35:16.806534 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Id: 56f8367a52044e82a2c272da39e1bfd8 Jun 14 18:35:16.806534 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1598181014 Jun 14 18:35:16.806534 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User: tempest-AttachVolumeNegativeTest-1598181014-project Jun 14 18:35:16.806534 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Id: default Jun 14 18:35:16.806534 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Name: Default Jun 14 18:35:16.806534 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Id: 9254bd46822346009497b01d28314335 Jun 14 18:35:16.806534 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Name: tempest-AttachVolumeNegativeTest-1598181014-project Jun 14 18:35:16.806534 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: method: > Jun 14 18:35:16.806534 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: exception: Instance 17641e09-70b6-4020-9fb5-31780056f2d9 could not be found. Jun 14 18:35:16.806534 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: action_args: {'id': '17641e09-70b6-4020-9fb5-31780056f2d9'} Jun 14 18:35:16.810109 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:35:16.810109 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:16.810109 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:35:16.810109 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:35:16.810109 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:35:16.810109 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:35:16.810109 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:35:16.810109 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:35:16.810109 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:35:16.810109 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:35:16.810109 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17641e09-70b6-4020-9fb5-31780056f2d9 could not be found. Jun 14 18:35:16.810109 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:35:16.810109 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:35:16.810109 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:35:16.810109 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:16.810109 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:35:16.810109 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:35:16.810109 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:35:16.810109 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:35:16.810109 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:35:16.814034 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:35:16.814034 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:35:16.814034 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:35:16.814034 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:35:16.814034 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:35:16.814034 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:35:16.814034 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:35:16.814034 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17641e09-70b6-4020-9fb5-31780056f2d9 could not be found. Jun 14 18:35:16.814034 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:35:16.814034 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:35:16.814034 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:35:16.814034 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:16.814034 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:35:16.814034 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:35:16.814034 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:35:16.814034 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:35:16.814034 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17641e09-70b6-4020-9fb5-31780056f2d9 could not be found. Jun 14 18:35:16.814034 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:35:16.816650 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-c5ca929a-f86f-4996-9813-3578614afa9f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] Returning 404 to user: Instance 17641e09-70b6-4020-9fb5-31780056f2d9 could not be found. {{(pid=118624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:35:16.816650 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-c5ca929a-f86f-4996-9813-3578614afa9f tempest-AttachVolumeNegativeTest-1598181014 tempest-AttachVolumeNegativeTest-1598181014-project] 10.222.0.78 "GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9" status: 404 len: 111 microversion: 2.1 time: 0.039267 Jun 14 18:35:16.816650 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 485/947] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:16 2022] GET /compute/v2.1/servers/17641e09-70b6-4020-9fb5-31780056f2d9 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:35:16.964391 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-6a48506b-272a-4a65-9b60-fd4ad2b5f762 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:16.965513 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-6a48506b-272a-4a65-9b60-fd4ad2b5f762 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:16.972789 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6a48506b-272a-4a65-9b60-fd4ad2b5f762 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:16.973235 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6a48506b-272a-4a65-9b60-fd4ad2b5f762 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:16.974262 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6a48506b-272a-4a65-9b60-fd4ad2b5f762 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:16.974794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6a48506b-272a-4a65-9b60-fd4ad2b5f762 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:17.070482 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-6a48506b-272a-4a65-9b60-fd4ad2b5f762 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:35:17.083212 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-6a48506b-272a-4a65-9b60-fd4ad2b5f762 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1220 microversion: 2.1 time: 0.122800 Jun 14 18:35:17.089948 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 463/948] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:16 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1220 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:35:18.101600 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-9bc70cc4-4bdf-48a5-a4e3-b0e1326351a3 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:18.104414 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-9bc70cc4-4bdf-48a5-a4e3-b0e1326351a3 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:18.114572 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9bc70cc4-4bdf-48a5-a4e3-b0e1326351a3 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:18.115529 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9bc70cc4-4bdf-48a5-a4e3-b0e1326351a3 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:18.116489 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9bc70cc4-4bdf-48a5-a4e3-b0e1326351a3 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:18.117111 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9bc70cc4-4bdf-48a5-a4e3-b0e1326351a3 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:18.216480 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9bc70cc4-4bdf-48a5-a4e3-b0e1326351a3 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:18.216480 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9bc70cc4-4bdf-48a5-a4e3-b0e1326351a3 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:18.216480 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.objects.instance [None req-9bc70cc4-4bdf-48a5-a4e3-b0e1326351a3 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lazy-loading 'fault' on Instance uuid 750a5111-2788-46b6-aa18-57f7c1019d64 {{(pid=118624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:35:18.264442 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-9bc70cc4-4bdf-48a5-a4e3-b0e1326351a3 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a00b33efb04f55b1d3c0a985536df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f86b97f3c4725955bc1f71017af5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:35:18.277290 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-9bc70cc4-4bdf-48a5-a4e3-b0e1326351a3 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 200 len: 1225 microversion: 2.1 time: 0.180496 Jun 14 18:35:18.278649 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 486/949] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:18 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 1225 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:35:19.296688 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-023c47e8-609e-4d31-a53c-aea188acc238 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:19.301543 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-023c47e8-609e-4d31-a53c-aea188acc238 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] [instance: 750a5111-2788-46b6-aa18-57f7c1019d64] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:19.305426 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-023c47e8-609e-4d31-a53c-aea188acc238 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:19.306075 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-023c47e8-609e-4d31-a53c-aea188acc238 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:19.306850 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-023c47e8-609e-4d31-a53c-aea188acc238 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:19.307372 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-023c47e8-609e-4d31-a53c-aea188acc238 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:19.323362 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.wsgi [None req-023c47e8-609e-4d31-a53c-aea188acc238 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] HTTP exception thrown: Instance 750a5111-2788-46b6-aa18-57f7c1019d64 could not be found. Jun 14 18:35:19.326306 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-023c47e8-609e-4d31-a53c-aea188acc238 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Request method failure captured: Jun 14 18:35:19.326306 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: request: GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 HTTP/1.1 Jun 14 18:35:19.326306 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept: application/json Jun 14 18:35:19.326306 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept-Encoding: identity Jun 14 18:35:19.326306 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Connection: close Jun 14 18:35:19.326306 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Length: 0 Jun 14 18:35:19.326306 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Type: application/json Jun 14 18:35:19.326306 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Host: 10.222.0.78 Jun 14 18:35:19.326306 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Openstack-System-Scope: None Jun 14 18:35:19.326306 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: User-Agent: python-urllib3/1.26.9 Jun 14 18:35:19.326306 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Auth-Token: gAAAAABiqNNmxmMFhSa6DPUWKmfbucxbewoUa0JxY_heg1KvYK8CZrQmH4TDsmbViMNDtRWQWgZ4lxOClrCcumVXS0CP8R_XmSEGe8WwQeXJt-RiN925KvAYmTp1x7NtwU9jp5krSkfaZ33mikFU81gnSELZzcSh1jo3wJyDV9yWtub0jCLWTBQ Jun 14 18:35:19.326306 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Id: None Jun 14 18:35:19.326306 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Name: None Jun 14 18:35:19.326306 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Identity-Status: Confirmed Jun 14 18:35:19.326306 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Is-Admin-Project: True Jun 14 18:35:19.326306 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Id: default Jun 14 18:35:19.326306 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Name: Default Jun 14 18:35:19.326306 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Id: 437f86b97f3c4725955bc1f71017af5e Jun 14 18:35:19.326306 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Name: tempest-TestShelveInstance-972342894 Jun 14 18:35:19.326306 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Role: reader,member Jun 14 18:35:19.326306 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Roles: reader,member Jun 14 18:35:19.327989 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_437f86b97f3c4725955bc1f71017af5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/437f86b97f3c4725955bc1f71017af5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/437f86b97f3c4725955bc1f71017af5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/437f86b97f3c4725955bc1f71017af5e"}]}] Jun 14 18:35:19.327989 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant: tempest-TestShelveInstance-972342894 Jun 14 18:35:19.327989 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Id: 437f86b97f3c4725955bc1f71017af5e Jun 14 18:35:19.327989 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Name: tempest-TestShelveInstance-972342894 Jun 14 18:35:19.327989 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User: tempest-TestShelveInstance-972342894-project Jun 14 18:35:19.327989 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Id: default Jun 14 18:35:19.327989 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Name: Default Jun 14 18:35:19.327989 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Id: 48a00b33efb04f55b1d3c0a985536df2 Jun 14 18:35:19.327989 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Name: tempest-TestShelveInstance-972342894-project Jun 14 18:35:19.327989 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: method: > Jun 14 18:35:19.327989 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: exception: Instance 750a5111-2788-46b6-aa18-57f7c1019d64 could not be found. Jun 14 18:35:19.327989 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: action_args: {'id': '750a5111-2788-46b6-aa18-57f7c1019d64'} Jun 14 18:35:19.329096 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:35:19.329096 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:19.329096 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:35:19.329096 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:35:19.329096 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:35:19.329096 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:35:19.329096 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:35:19.329096 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:35:19.329096 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:35:19.329096 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:35:19.329096 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 750a5111-2788-46b6-aa18-57f7c1019d64 could not be found. Jun 14 18:35:19.329096 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:19.329096 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:35:19.329096 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:19.329096 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:19.329096 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:35:19.329096 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:35:19.329096 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:35:19.329096 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:35:19.329096 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:35:19.336361 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:35:19.336361 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:35:19.336361 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:35:19.336361 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:35:19.336361 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:35:19.336361 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:35:19.336361 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:35:19.336361 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 750a5111-2788-46b6-aa18-57f7c1019d64 could not be found. Jun 14 18:35:19.336361 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:19.336361 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:35:19.336361 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:19.336361 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:19.336361 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:35:19.336361 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:35:19.336361 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:35:19.336361 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:35:19.336361 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 750a5111-2788-46b6-aa18-57f7c1019d64 could not be found. Jun 14 18:35:19.336361 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:19.337763 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-023c47e8-609e-4d31-a53c-aea188acc238 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Returning 404 to user: Instance 750a5111-2788-46b6-aa18-57f7c1019d64 could not be found. {{(pid=118623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:35:19.337763 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-023c47e8-609e-4d31-a53c-aea188acc238 tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64" status: 404 len: 111 microversion: 2.1 time: 0.038727 Jun 14 18:35:19.337763 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 464/950] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:19 2022] GET /compute/v2.1/servers/750a5111-2788-46b6-aa18-57f7c1019d64 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:35:19.719864 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-667b2c2e-48f1-4c78-ab39-2343e0c9f20c tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] Calling method '.version_select at 0x7efe704d3e50>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:19.861778 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-667b2c2e-48f1-4c78-ab39-2343e0c9f20c tempest-TestShelveInstance-972342894 tempest-TestShelveInstance-972342894-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1240575293" status: 202 len: 0 microversion: 2.1 time: 0.146487 Jun 14 18:35:19.862617 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 487/951] 10.222.0.78 () {58 vars in 1253 bytes} [Tue Jun 14 18:35:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1240575293 => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 14 18:35:24.925908 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-82783be1-f976-43b8-8107-c5c54a92d4be tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] Action: 'create', calling method: .version_select at 0x7efe709f6940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-792775794"}} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:35:25.851407 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-82783be1-f976-43b8-8107-c5c54a92d4be tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.090913 Jun 14 18:35:25.852122 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 465/952] 10.222.0.78 () {60 vars in 1154 bytes} [Tue Jun 14 18:35:24 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1092 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 14 18:35:25.864276 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-8cd2ff7c-7ac5-4e33-9ae7-3226fbf45b0b tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] Calling method '.version_select at 0x7efe71f7d550>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:25.916184 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-8cd2ff7c-7ac5-4e33-9ae7-3226fbf45b0b tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/9e52a7d3-6e08-4f1a-be09-a24b8612caa8" status: 200 len: 344 microversion: 2.1 time: 0.056420 Jun 14 18:35:25.916748 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 488/953] 10.222.0.78 () {58 vars in 1244 bytes} [Tue Jun 14 18:35:25 2022] GET /compute/v2.1/os-volumes/9e52a7d3-6e08-4f1a-be09-a24b8612caa8 => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:35:26.902888 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-4deccebe-5f7a-4e7b-88b5-173118005d3f tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1427798299", "imageRef": "e2555120-8576-4128-944f-40805aa95a9b", "flavorRef": "452", "networks": [{"uuid": "91c5a939-2b5d-4f8f-b89e-1ae52321b35f"}]}} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:35:26.931167 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-8d369b75-f834-41d6-9486-00285aefd514 tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] Calling method '.version_select at 0x7efe7300bf70>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:26.984474 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.network.neutron [None req-4deccebe-5f7a-4e7b-88b5-173118005d3f tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] validate_networks() for [('91c5a939-2b5d-4f8f-b89e-1ae52321b35f', None, None, None, None, None)] {{(pid=118623) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 18:35:26.995885 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-8d369b75-f834-41d6-9486-00285aefd514 tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/9e52a7d3-6e08-4f1a-be09-a24b8612caa8" status: 200 len: 345 microversion: 2.1 time: 0.068907 Jun 14 18:35:26.996594 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 489/954] 10.222.0.78 () {58 vars in 1244 bytes} [Tue Jun 14 18:35:26 2022] GET /compute/v2.1/os-volumes/9e52a7d3-6e08-4f1a-be09-a24b8612caa8 => generated 345 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:35:27.007960 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-230a9f17-3721-48aa-8bc5-2573c760c783 tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] Action: 'create', calling method: .version_select at 0x7efe7064f4c0>, body: {"snapshot": {"volume_id": "9e52a7d3-6e08-4f1a-be09-a24b8612caa8", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-425912817"}} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:35:27.640724 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-230a9f17-3721-48aa-8bc5-2573c760c783 tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] 10.222.0.78 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.636606 Jun 14 18:35:27.641469 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 490/955] 10.222.0.78 () {60 vars in 1161 bytes} [Tue Jun 14 18:35:27 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:35:27.653020 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-b7cd7948-65d7-4728-a349-d6ffc71a2435 tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] Calling method '.version_select at 0x7efe70628c10>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:27.698388 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-b7cd7948-65d7-4728-a349-d6ffc71a2435 tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/ca68de20-1a21-40e0-8a7e-d965967c75f8" status: 200 len: 286 microversion: 2.1 time: 0.050620 Jun 14 18:35:27.699909 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 491/956] 10.222.0.78 () {58 vars in 1250 bytes} [Tue Jun 14 18:35:27 2022] GET /compute/v2.1/os-snapshots/ca68de20-1a21-40e0-8a7e-d965967c75f8 => generated 286 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:35:27.709891 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-21aa7184-4698-422b-9721-05df7a98782f tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] Calling method '.version_select at 0x7efe706bb550>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:27.743761 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-21aa7184-4698-422b-9721-05df7a98782f tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.037469 Jun 14 18:35:27.744227 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 492/957] 10.222.0.78 () {58 vars in 1139 bytes} [Tue Jun 14 18:35:27 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:35:27.756637 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-15cc1457-cb01-48b6-ad74-c759dc70927a tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] Calling method '.version_select at 0x7efe704d3430>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:27.797229 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-15cc1457-cb01-48b6-ad74-c759dc70927a tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/ca68de20-1a21-40e0-8a7e-d965967c75f8" status: 200 len: 286 microversion: 2.1 time: 0.040169 Jun 14 18:35:27.797229 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 493/958] 10.222.0.78 () {58 vars in 1250 bytes} [Tue Jun 14 18:35:27 2022] GET /compute/v2.1/os-snapshots/ca68de20-1a21-40e0-8a7e-d965967c75f8 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:35:27.984038 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-4deccebe-5f7a-4e7b-88b5-173118005d3f tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Flavor limits 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 18:35:27.984522 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-4deccebe-5f7a-4e7b-88b5-173118005d3f tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Image limits 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 18:35:27.984963 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-4deccebe-5f7a-4e7b-88b5-173118005d3f tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Flavor pref 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 18:35:27.985610 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-4deccebe-5f7a-4e7b-88b5-173118005d3f tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Image pref 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 18:35:27.986032 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-4deccebe-5f7a-4e7b-88b5-173118005d3f tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 18:35:27.997373 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4deccebe-5f7a-4e7b-88b5-173118005d3f tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:27.997881 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4deccebe-5f7a-4e7b-88b5-173118005d3f tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:27.998750 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4deccebe-5f7a-4e7b-88b5-173118005d3f tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:27.999195 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4deccebe-5f7a-4e7b-88b5-173118005d3f tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:28.019658 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.quota [None req-4deccebe-5f7a-4e7b-88b5-173118005d3f tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Getting quotas for project eea5688a5de847c7bb66afa3c46c759a. Resources: {'instances', 'cores', 'ram'} {{(pid=118623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:35:28.024623 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.quota [None req-4deccebe-5f7a-4e7b-88b5-173118005d3f tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Getting quotas for user 7e5d400872474e619ec7b97724021e25 and project eea5688a5de847c7bb66afa3c46c759a. Resources: {'instances', 'cores', 'ram'} {{(pid=118623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:35:28.039844 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-4deccebe-5f7a-4e7b-88b5-173118005d3f tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Going to run 1 instances... {{(pid=118623) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 18:35:28.042375 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-4deccebe-5f7a-4e7b-88b5-173118005d3f tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] [instance: b2731df7-b150-4a46-830e-90cb335e2c77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e2555120-8576-4128-944f-40805aa95a9b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118623) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 18:35:28.241420 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-4deccebe-5f7a-4e7b-88b5-173118005d3f tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.343590 Jun 14 18:35:28.245355 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 466/959] 10.222.0.78 () {60 vars in 1146 bytes} [Tue Jun 14 18:35:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1348 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 18:35:28.253532 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-9f2a3327-bfc6-4588-a041-bb0fc644b192 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:28.254485 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-9f2a3327-bfc6-4588-a041-bb0fc644b192 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] [instance: b2731df7-b150-4a46-830e-90cb335e2c77] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:28.289902 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell1:SELECT=64 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:35:28.336585 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-9f2a3327-bfc6-4588-a041-bb0fc644b192 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5d400872474e619ec7b97724021e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea5688a5de847c7bb66afa3c46c759a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:35:28.346671 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-9f2a3327-bfc6-4588-a041-bb0fc644b192 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] 10.222.0.78 "GET /compute/v2.1/servers/b2731df7-b150-4a46-830e-90cb335e2c77" status: 200 len: 1214 microversion: 2.1 time: 0.096768 Jun 14 18:35:28.346671 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 494/960] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:28 2022] GET /compute/v2.1/servers/b2731df7-b150-4a46-830e-90cb335e2c77 => generated 1214 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:35:28.805382 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-6ab4ebde-7e1a-48d4-aef6-da2cbd8546bd tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] Calling method '.version_select at 0x7efe7154dee0>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:28.841179 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-6ab4ebde-7e1a-48d4-aef6-da2cbd8546bd tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/ca68de20-1a21-40e0-8a7e-d965967c75f8" status: 200 len: 286 microversion: 2.1 time: 0.039846 Jun 14 18:35:28.841783 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 467/961] 10.222.0.78 () {58 vars in 1250 bytes} [Tue Jun 14 18:35:28 2022] GET /compute/v2.1/os-snapshots/ca68de20-1a21-40e0-8a7e-d965967c75f8 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:35:29.364301 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-8b74fd43-401c-4dda-90af-5e52db32d4f6 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:29.364917 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-8b74fd43-401c-4dda-90af-5e52db32d4f6 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] [instance: b2731df7-b150-4a46-830e-90cb335e2c77] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:29.468125 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-8b74fd43-401c-4dda-90af-5e52db32d4f6 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5d400872474e619ec7b97724021e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea5688a5de847c7bb66afa3c46c759a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:35:29.471913 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-8b74fd43-401c-4dda-90af-5e52db32d4f6 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] 10.222.0.78 "GET /compute/v2.1/servers/b2731df7-b150-4a46-830e-90cb335e2c77" status: 200 len: 1214 microversion: 2.1 time: 0.112274 Jun 14 18:35:29.472504 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 495/962] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:29 2022] GET /compute/v2.1/servers/b2731df7-b150-4a46-830e-90cb335e2c77 => generated 1214 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:35:29.853026 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-333c56cc-926b-49bc-8899-909d58a12661 tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] Calling method '.version_select at 0x7efe70ab6820>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:29.915343 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-333c56cc-926b-49bc-8899-909d58a12661 tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/ca68de20-1a21-40e0-8a7e-d965967c75f8" status: 200 len: 286 microversion: 2.1 time: 0.066804 Jun 14 18:35:29.918567 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 468/963] 10.222.0.78 () {58 vars in 1250 bytes} [Tue Jun 14 18:35:29 2022] GET /compute/v2.1/os-snapshots/ca68de20-1a21-40e0-8a7e-d965967c75f8 => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:35:30.490701 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-c63b1d4a-81db-4c72-8e8e-ac3341975591 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:30.491305 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-c63b1d4a-81db-4c72-8e8e-ac3341975591 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] [instance: b2731df7-b150-4a46-830e-90cb335e2c77] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:30.499198 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c63b1d4a-81db-4c72-8e8e-ac3341975591 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:30.499643 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c63b1d4a-81db-4c72-8e8e-ac3341975591 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:30.500435 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c63b1d4a-81db-4c72-8e8e-ac3341975591 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:30.500924 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c63b1d4a-81db-4c72-8e8e-ac3341975591 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:30.563981 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-c63b1d4a-81db-4c72-8e8e-ac3341975591 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5d400872474e619ec7b97724021e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea5688a5de847c7bb66afa3c46c759a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:35:30.573648 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-c63b1d4a-81db-4c72-8e8e-ac3341975591 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] 10.222.0.78 "GET /compute/v2.1/servers/b2731df7-b150-4a46-830e-90cb335e2c77" status: 200 len: 1218 microversion: 2.1 time: 0.086654 Jun 14 18:35:30.574537 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 496/964] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:30 2022] GET /compute/v2.1/servers/b2731df7-b150-4a46-830e-90cb335e2c77 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:35:30.935605 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-ef714fdb-c215-43b7-a7ab-ba79df70d9d9 tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] Calling method '.version_select at 0x7efe70a6bc10>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:30.977963 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-ef714fdb-c215-43b7-a7ab-ba79df70d9d9 tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/ca68de20-1a21-40e0-8a7e-d965967c75f8" status: 200 len: 287 microversion: 2.1 time: 0.053602 Jun 14 18:35:30.985013 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 469/965] 10.222.0.78 () {58 vars in 1250 bytes} [Tue Jun 14 18:35:30 2022] GET /compute/v2.1/os-snapshots/ca68de20-1a21-40e0-8a7e-d965967c75f8 => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:35:30.989953 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-7384dad6-514c-41cc-9728-54631a478a6b tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] Calling method '.version_select at 0x7efe704673a0>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:31.156451 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-7384dad6-514c-41cc-9728-54631a478a6b tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] 10.222.0.78 "DELETE /compute/v2.1/os-snapshots/ca68de20-1a21-40e0-8a7e-d965967c75f8" status: 202 len: 0 microversion: 2.1 time: 0.169984 Jun 14 18:35:31.156753 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 497/966] 10.222.0.78 () {58 vars in 1253 bytes} [Tue Jun 14 18:35:30 2022] DELETE /compute/v2.1/os-snapshots/ca68de20-1a21-40e0-8a7e-d965967c75f8 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:35:31.165597 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-de8703cb-bf94-413e-b806-5860f073e990 tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] Calling method '.version_select at 0x7efe70b6e820>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:31.202602 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-de8703cb-bf94-413e-b806-5860f073e990 tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/ca68de20-1a21-40e0-8a7e-d965967c75f8" status: 200 len: 286 microversion: 2.1 time: 0.041747 Jun 14 18:35:31.203319 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 470/967] 10.222.0.78 () {58 vars in 1250 bytes} [Tue Jun 14 18:35:31 2022] GET /compute/v2.1/os-snapshots/ca68de20-1a21-40e0-8a7e-d965967c75f8 => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:35:31.593035 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-65f3e0fd-ab7b-4dba-8af6-16fc9cc48f7f tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:31.594680 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-65f3e0fd-ab7b-4dba-8af6-16fc9cc48f7f tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] [instance: b2731df7-b150-4a46-830e-90cb335e2c77] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:31.601054 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-65f3e0fd-ab7b-4dba-8af6-16fc9cc48f7f tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:31.601540 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-65f3e0fd-ab7b-4dba-8af6-16fc9cc48f7f tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:31.602319 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-65f3e0fd-ab7b-4dba-8af6-16fc9cc48f7f tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:31.603036 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-65f3e0fd-ab7b-4dba-8af6-16fc9cc48f7f tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:31.676655 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-65f3e0fd-ab7b-4dba-8af6-16fc9cc48f7f tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5d400872474e619ec7b97724021e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea5688a5de847c7bb66afa3c46c759a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:35:31.684676 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-65f3e0fd-ab7b-4dba-8af6-16fc9cc48f7f tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] 10.222.0.78 "GET /compute/v2.1/servers/b2731df7-b150-4a46-830e-90cb335e2c77" status: 200 len: 1274 microversion: 2.1 time: 0.096933 Jun 14 18:35:31.685313 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 498/968] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:31 2022] GET /compute/v2.1/servers/b2731df7-b150-4a46-830e-90cb335e2c77 => generated 1274 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:35:32.215873 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-c538a742-7512-45c0-ac9f-719b3610902d tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] Calling method '.version_select at 0x7efe70a6d430>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:32.242860 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.wsgi [None req-c538a742-7512-45c0-ac9f-719b3610902d tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] HTTP exception thrown: Snapshot ca68de20-1a21-40e0-8a7e-d965967c75f8 could not be found. Jun 14 18:35:32.245143 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-c538a742-7512-45c0-ac9f-719b3610902d tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] Request method failure captured: Jun 14 18:35:32.245143 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: request: GET /compute/v2.1/os-snapshots/ca68de20-1a21-40e0-8a7e-d965967c75f8 HTTP/1.1 Jun 14 18:35:32.245143 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept: application/json Jun 14 18:35:32.245143 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept-Encoding: identity Jun 14 18:35:32.245143 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Connection: close Jun 14 18:35:32.245143 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Length: 0 Jun 14 18:35:32.245143 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Type: application/json Jun 14 18:35:32.245143 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Host: 10.222.0.78 Jun 14 18:35:32.245143 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Openstack-System-Scope: None Jun 14 18:35:32.245143 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: User-Agent: python-urllib3/1.26.9 Jun 14 18:35:32.245143 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Auth-Token: gAAAAABiqNTsB2U_srPATM1oP2AGxLZw4pPJPnFARcHoFkGWj7zdRh7pKuJEPrhQCBER4eCArLdKdCGnWbTB31Ytkmrd4ghQ99HljKagF7Rmoqv1_1f2hqyFN8LnAkc07Xn9gkqVvwFkyp0iNo8GZwnOmQqXVBkRhDnGRrETyr3wOgJW-ZV-M94 Jun 14 18:35:32.245143 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Id: None Jun 14 18:35:32.245143 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Name: None Jun 14 18:35:32.245143 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Identity-Status: Confirmed Jun 14 18:35:32.245143 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Is-Admin-Project: True Jun 14 18:35:32.245143 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Id: default Jun 14 18:35:32.245143 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Name: Default Jun 14 18:35:32.245143 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Id: fb38b7fc4f81427a9ce03e1adc64a7c9 Jun 14 18:35:32.245143 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1168419935 Jun 14 18:35:32.245143 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Role: reader,member Jun 14 18:35:32.245143 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Roles: reader,member Jun 14 18:35:32.247444 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_fb38b7fc4f81427a9ce03e1adc64a7c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fb38b7fc4f81427a9ce03e1adc64a7c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fb38b7fc4f81427a9ce03e1adc64a7c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/fb38b7fc4f81427a9ce03e1adc64a7c9"}]}] Jun 14 18:35:32.247444 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1168419935 Jun 14 18:35:32.247444 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Id: fb38b7fc4f81427a9ce03e1adc64a7c9 Jun 14 18:35:32.247444 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1168419935 Jun 14 18:35:32.247444 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User: tempest-VolumesSnapshotsTestJSON-1168419935-project Jun 14 18:35:32.247444 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Id: default Jun 14 18:35:32.247444 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Name: Default Jun 14 18:35:32.247444 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Id: c804343e481d4bb297f1a14a289dac99 Jun 14 18:35:32.247444 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1168419935-project Jun 14 18:35:32.247444 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: method: Jun 14 18:35:32.247444 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: exception: Snapshot ca68de20-1a21-40e0-8a7e-d965967c75f8 could not be found. Jun 14 18:35:32.247444 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: action_args: {'id': 'ca68de20-1a21-40e0-8a7e-d965967c75f8'} Jun 14 18:35:32.247444 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:35:32.248558 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:32.248558 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 14 18:35:32.248558 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 14 18:35:32.248558 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 14 18:35:32.248558 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 14 18:35:32.248558 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 14 18:35:32.248558 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 14 18:35:32.248558 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 14 18:35:32.248558 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 14 18:35:32.248558 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 14 18:35:32.248558 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 14 18:35:32.248558 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 18:35:32.248558 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 18:35:32.248558 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 18:35:32.248558 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 18:35:32.248558 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot ca68de20-1a21-40e0-8a7e-d965967c75f8 could not be found. (HTTP 404) (Request-ID: req-3388d80b-4298-402d-babc-4759b2a97fa0) Jun 14 18:35:32.248558 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:32.248558 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:35:32.249794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:32.249794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:32.249794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 14 18:35:32.249794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 14 18:35:32.249794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 14 18:35:32.249794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 14 18:35:32.249794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 14 18:35:32.249794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 14 18:35:32.249794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 14 18:35:32.249794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 14 18:35:32.249794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 14 18:35:32.249794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 14 18:35:32.249794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 14 18:35:32.249794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 14 18:35:32.249794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 14 18:35:32.249794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 14 18:35:32.249794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 14 18:35:32.249794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 14 18:35:32.249794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 14 18:35:32.251116 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 14 18:35:32.251116 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 18:35:32.251116 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 18:35:32.251116 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 18:35:32.251116 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 18:35:32.251116 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot ca68de20-1a21-40e0-8a7e-d965967c75f8 could not be found. Jun 14 18:35:32.251116 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:32.251116 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:35:32.251116 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:32.251116 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:32.251116 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:35:32.251116 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:35:32.251116 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:35:32.251116 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:35:32.251116 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 14 18:35:32.251116 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 14 18:35:32.251116 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:35:32.251116 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:35:32.251116 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 14 18:35:32.251116 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:35:32.252508 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot ca68de20-1a21-40e0-8a7e-d965967c75f8 could not be found. Jun 14 18:35:32.252508 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:32.252508 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:35:32.252508 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:32.252508 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:32.252508 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:35:32.252508 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:35:32.252508 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:35:32.252508 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:35:32.252508 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot ca68de20-1a21-40e0-8a7e-d965967c75f8 could not be found. Jun 14 18:35:32.252508 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:32.252508 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-c538a742-7512-45c0-ac9f-719b3610902d tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] Returning 404 to user: Snapshot ca68de20-1a21-40e0-8a7e-d965967c75f8 could not be found. {{(pid=118623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:35:32.252508 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-c538a742-7512-45c0-ac9f-719b3610902d tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/ca68de20-1a21-40e0-8a7e-d965967c75f8" status: 404 len: 111 microversion: 2.1 time: 0.035994 Jun 14 18:35:32.256449 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-b0455d33-449f-49ba-bf95-ef80f569f4ea tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] Calling method '.version_select at 0x7efe70413e50>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:32.261876 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 471/969] 10.222.0.78 () {58 vars in 1250 bytes} [Tue Jun 14 18:35:32 2022] GET /compute/v2.1/os-snapshots/ca68de20-1a21-40e0-8a7e-d965967c75f8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 14 18:35:32.575416 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-b0455d33-449f-49ba-bf95-ef80f569f4ea tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/9e52a7d3-6e08-4f1a-be09-a24b8612caa8" status: 202 len: 0 microversion: 2.1 time: 0.322645 Jun 14 18:35:32.580752 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 499/970] 10.222.0.78 () {58 vars in 1247 bytes} [Tue Jun 14 18:35:32 2022] DELETE /compute/v2.1/os-volumes/9e52a7d3-6e08-4f1a-be09-a24b8612caa8 => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:35:32.586750 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-a63dafe0-fb4b-4f51-bff6-c8f689fc81b0 tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] Calling method '.version_select at 0x7efe70b6e790>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:32.637979 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-a63dafe0-fb4b-4f51-bff6-c8f689fc81b0 tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/9e52a7d3-6e08-4f1a-be09-a24b8612caa8" status: 200 len: 344 microversion: 2.1 time: 0.055789 Jun 14 18:35:32.638584 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 472/971] 10.222.0.78 () {58 vars in 1244 bytes} [Tue Jun 14 18:35:32 2022] GET /compute/v2.1/os-volumes/9e52a7d3-6e08-4f1a-be09-a24b8612caa8 => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:35:32.702911 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-bfe1dbf7-a012-4100-8cce-3695c1e7e690 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:32.703611 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-bfe1dbf7-a012-4100-8cce-3695c1e7e690 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] [instance: b2731df7-b150-4a46-830e-90cb335e2c77] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:32.709902 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-bfe1dbf7-a012-4100-8cce-3695c1e7e690 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:32.710420 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-bfe1dbf7-a012-4100-8cce-3695c1e7e690 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:32.711102 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-bfe1dbf7-a012-4100-8cce-3695c1e7e690 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:32.711531 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-bfe1dbf7-a012-4100-8cce-3695c1e7e690 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:33.171649 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-bfe1dbf7-a012-4100-8cce-3695c1e7e690 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5d400872474e619ec7b97724021e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea5688a5de847c7bb66afa3c46c759a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:35:33.180812 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-bfe1dbf7-a012-4100-8cce-3695c1e7e690 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] 10.222.0.78 "GET /compute/v2.1/servers/b2731df7-b150-4a46-830e-90cb335e2c77" status: 200 len: 1314 microversion: 2.1 time: 0.482561 Jun 14 18:35:33.189602 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 500/972] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:32 2022] GET /compute/v2.1/servers/b2731df7-b150-4a46-830e-90cb335e2c77 => generated 1314 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:35:33.651932 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-ab6c6f8b-0b0f-44e5-be51-59339a3f8467 tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] Calling method '.version_select at 0x7efe70bae8b0>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:33.684071 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.wsgi [None req-ab6c6f8b-0b0f-44e5-be51-59339a3f8467 tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] HTTP exception thrown: Volume 9e52a7d3-6e08-4f1a-be09-a24b8612caa8 could not be found. Jun 14 18:35:33.686265 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-ab6c6f8b-0b0f-44e5-be51-59339a3f8467 tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] Request method failure captured: Jun 14 18:35:33.686265 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: request: GET /compute/v2.1/os-volumes/9e52a7d3-6e08-4f1a-be09-a24b8612caa8 HTTP/1.1 Jun 14 18:35:33.686265 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept: application/json Jun 14 18:35:33.686265 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept-Encoding: identity Jun 14 18:35:33.686265 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Connection: close Jun 14 18:35:33.686265 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Length: 0 Jun 14 18:35:33.686265 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Type: application/json Jun 14 18:35:33.686265 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Host: 10.222.0.78 Jun 14 18:35:33.686265 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Openstack-System-Scope: None Jun 14 18:35:33.686265 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: User-Agent: python-urllib3/1.26.9 Jun 14 18:35:33.686265 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Auth-Token: gAAAAABiqNTsB2U_srPATM1oP2AGxLZw4pPJPnFARcHoFkGWj7zdRh7pKuJEPrhQCBER4eCArLdKdCGnWbTB31Ytkmrd4ghQ99HljKagF7Rmoqv1_1f2hqyFN8LnAkc07Xn9gkqVvwFkyp0iNo8GZwnOmQqXVBkRhDnGRrETyr3wOgJW-ZV-M94 Jun 14 18:35:33.686265 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Id: None Jun 14 18:35:33.686265 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Name: None Jun 14 18:35:33.686265 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Identity-Status: Confirmed Jun 14 18:35:33.686265 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Is-Admin-Project: True Jun 14 18:35:33.686265 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Id: default Jun 14 18:35:33.686265 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Name: Default Jun 14 18:35:33.686265 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Id: fb38b7fc4f81427a9ce03e1adc64a7c9 Jun 14 18:35:33.686265 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1168419935 Jun 14 18:35:33.686265 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Role: reader,member Jun 14 18:35:33.686265 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Roles: reader,member Jun 14 18:35:33.687622 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_fb38b7fc4f81427a9ce03e1adc64a7c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fb38b7fc4f81427a9ce03e1adc64a7c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fb38b7fc4f81427a9ce03e1adc64a7c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/fb38b7fc4f81427a9ce03e1adc64a7c9"}]}] Jun 14 18:35:33.687622 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1168419935 Jun 14 18:35:33.687622 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Id: fb38b7fc4f81427a9ce03e1adc64a7c9 Jun 14 18:35:33.687622 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1168419935 Jun 14 18:35:33.687622 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User: tempest-VolumesSnapshotsTestJSON-1168419935-project Jun 14 18:35:33.687622 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Id: default Jun 14 18:35:33.687622 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Name: Default Jun 14 18:35:33.687622 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Id: c804343e481d4bb297f1a14a289dac99 Jun 14 18:35:33.687622 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1168419935-project Jun 14 18:35:33.687622 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: method: Jun 14 18:35:33.687622 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: exception: Volume 9e52a7d3-6e08-4f1a-be09-a24b8612caa8 could not be found. Jun 14 18:35:33.687622 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: action_args: {'id': '9e52a7d3-6e08-4f1a-be09-a24b8612caa8'} Jun 14 18:35:33.687622 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:35:33.688432 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:33.688432 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 14 18:35:33.688432 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 14 18:35:33.688432 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 14 18:35:33.688432 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 14 18:35:33.688432 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 14 18:35:33.688432 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 14 18:35:33.688432 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 14 18:35:33.688432 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 14 18:35:33.688432 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 14 18:35:33.688432 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 14 18:35:33.688432 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 18:35:33.688432 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 18:35:33.688432 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 18:35:33.688432 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 18:35:33.688432 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9e52a7d3-6e08-4f1a-be09-a24b8612caa8 could not be found. (HTTP 404) (Request-ID: req-f349103f-8fa2-4afb-a95e-72fd6610aad9) Jun 14 18:35:33.688432 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:33.688432 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:35:33.688432 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:33.689703 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:33.689703 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 14 18:35:33.689703 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 14 18:35:33.689703 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 14 18:35:33.689703 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 14 18:35:33.689703 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 14 18:35:33.689703 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 14 18:35:33.689703 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 14 18:35:33.689703 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 14 18:35:33.689703 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 14 18:35:33.689703 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 14 18:35:33.689703 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 14 18:35:33.689703 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 14 18:35:33.689703 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 14 18:35:33.689703 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 14 18:35:33.689703 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 14 18:35:33.689703 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 14 18:35:33.689703 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 14 18:35:33.689703 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 14 18:35:33.692906 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 18:35:33.692906 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 18:35:33.692906 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 18:35:33.692906 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 18:35:33.692906 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9e52a7d3-6e08-4f1a-be09-a24b8612caa8 could not be found. Jun 14 18:35:33.692906 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:33.692906 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:35:33.692906 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:33.692906 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:33.692906 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:35:33.692906 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:35:33.692906 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:35:33.692906 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:35:33.692906 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 14 18:35:33.692906 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 14 18:35:33.692906 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:35:33.692906 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:35:33.692906 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 14 18:35:33.692906 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:35:33.696609 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9e52a7d3-6e08-4f1a-be09-a24b8612caa8 could not be found. Jun 14 18:35:33.696609 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:33.696609 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:35:33.696609 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:33.696609 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:33.696609 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:35:33.696609 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:35:33.696609 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:35:33.696609 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:35:33.696609 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9e52a7d3-6e08-4f1a-be09-a24b8612caa8 could not be found. Jun 14 18:35:33.696609 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:33.696609 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-ab6c6f8b-0b0f-44e5-be51-59339a3f8467 tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] Returning 404 to user: Volume 9e52a7d3-6e08-4f1a-be09-a24b8612caa8 could not be found. {{(pid=118623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:35:33.696609 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-ab6c6f8b-0b0f-44e5-be51-59339a3f8467 tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/9e52a7d3-6e08-4f1a-be09-a24b8612caa8" status: 404 len: 109 microversion: 2.1 time: 0.040596 Jun 14 18:35:33.696609 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 473/973] 10.222.0.78 () {58 vars in 1244 bytes} [Tue Jun 14 18:35:33 2022] GET /compute/v2.1/os-volumes/9e52a7d3-6e08-4f1a-be09-a24b8612caa8 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 14 18:35:33.704152 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-b3db29e2-c29a-4956-b06a-1adccc5ab8bf tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] Calling method '.version_select at 0x7efe70104160>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:33.740189 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.wsgi [None req-b3db29e2-c29a-4956-b06a-1adccc5ab8bf tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] HTTP exception thrown: Volume 9e52a7d3-6e08-4f1a-be09-a24b8612caa8 could not be found. Jun 14 18:35:33.740189 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-b3db29e2-c29a-4956-b06a-1adccc5ab8bf tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] Request method failure captured: Jun 14 18:35:33.740189 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: request: DELETE /compute/v2.1/os-volumes/9e52a7d3-6e08-4f1a-be09-a24b8612caa8 HTTP/1.1 Jun 14 18:35:33.740189 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept: application/json Jun 14 18:35:33.740189 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept-Encoding: identity Jun 14 18:35:33.740189 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Connection: close Jun 14 18:35:33.740189 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Length: 0 Jun 14 18:35:33.740189 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Type: application/json Jun 14 18:35:33.740189 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Host: 10.222.0.78 Jun 14 18:35:33.740189 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Openstack-System-Scope: None Jun 14 18:35:33.740189 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: User-Agent: python-urllib3/1.26.9 Jun 14 18:35:33.740189 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Auth-Token: gAAAAABiqNTsB2U_srPATM1oP2AGxLZw4pPJPnFARcHoFkGWj7zdRh7pKuJEPrhQCBER4eCArLdKdCGnWbTB31Ytkmrd4ghQ99HljKagF7Rmoqv1_1f2hqyFN8LnAkc07Xn9gkqVvwFkyp0iNo8GZwnOmQqXVBkRhDnGRrETyr3wOgJW-ZV-M94 Jun 14 18:35:33.740189 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Id: None Jun 14 18:35:33.740189 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Name: None Jun 14 18:35:33.740189 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Identity-Status: Confirmed Jun 14 18:35:33.740189 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Is-Admin-Project: True Jun 14 18:35:33.740189 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Id: default Jun 14 18:35:33.740189 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Name: Default Jun 14 18:35:33.740189 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Id: fb38b7fc4f81427a9ce03e1adc64a7c9 Jun 14 18:35:33.740189 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1168419935 Jun 14 18:35:33.740189 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Role: reader,member Jun 14 18:35:33.740189 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Roles: reader,member Jun 14 18:35:33.741858 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_fb38b7fc4f81427a9ce03e1adc64a7c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fb38b7fc4f81427a9ce03e1adc64a7c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fb38b7fc4f81427a9ce03e1adc64a7c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/fb38b7fc4f81427a9ce03e1adc64a7c9"}]}] Jun 14 18:35:33.741858 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1168419935 Jun 14 18:35:33.741858 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Id: fb38b7fc4f81427a9ce03e1adc64a7c9 Jun 14 18:35:33.741858 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1168419935 Jun 14 18:35:33.741858 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User: tempest-VolumesSnapshotsTestJSON-1168419935-project Jun 14 18:35:33.741858 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Id: default Jun 14 18:35:33.741858 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Name: Default Jun 14 18:35:33.741858 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Id: c804343e481d4bb297f1a14a289dac99 Jun 14 18:35:33.741858 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1168419935-project Jun 14 18:35:33.741858 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: method: Jun 14 18:35:33.741858 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: exception: Volume 9e52a7d3-6e08-4f1a-be09-a24b8612caa8 could not be found. Jun 14 18:35:33.741858 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: action_args: {'id': '9e52a7d3-6e08-4f1a-be09-a24b8612caa8'} Jun 14 18:35:33.741858 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:35:33.742918 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:33.742918 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 14 18:35:33.742918 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 14 18:35:33.742918 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 14 18:35:33.742918 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 14 18:35:33.742918 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 14 18:35:33.742918 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 14 18:35:33.742918 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 14 18:35:33.742918 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 14 18:35:33.742918 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 14 18:35:33.742918 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 14 18:35:33.742918 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 18:35:33.742918 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 18:35:33.742918 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 18:35:33.742918 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 18:35:33.742918 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9e52a7d3-6e08-4f1a-be09-a24b8612caa8 could not be found. (HTTP 404) (Request-ID: req-fb71eb32-8141-4257-a588-57de96f7c05f) Jun 14 18:35:33.742918 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:35:33.742918 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:35:33.742918 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:35:33.744342 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:33.744342 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 14 18:35:33.744342 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 14 18:35:33.744342 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 14 18:35:33.744342 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 14 18:35:33.744342 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 14 18:35:33.744342 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 14 18:35:33.744342 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 14 18:35:33.744342 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 14 18:35:33.744342 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 14 18:35:33.744342 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 14 18:35:33.744342 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 14 18:35:33.744342 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 14 18:35:33.744342 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 14 18:35:33.744342 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 14 18:35:33.744342 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 14 18:35:33.744342 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 14 18:35:33.744342 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 14 18:35:33.744342 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 14 18:35:33.746337 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 18:35:33.746337 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 18:35:33.746337 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 18:35:33.746337 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 18:35:33.746337 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9e52a7d3-6e08-4f1a-be09-a24b8612caa8 could not be found. Jun 14 18:35:33.746337 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:35:33.746337 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:35:33.746337 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:35:33.746337 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:33.746337 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:35:33.746337 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:35:33.746337 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:35:33.746337 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:35:33.746337 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 14 18:35:33.746337 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 14 18:35:33.746337 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:35:33.746337 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:35:33.746337 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 14 18:35:33.746337 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:35:33.747739 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9e52a7d3-6e08-4f1a-be09-a24b8612caa8 could not be found. Jun 14 18:35:33.747739 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:35:33.747739 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:35:33.747739 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:35:33.747739 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:33.747739 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:35:33.747739 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:35:33.747739 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:35:33.747739 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:35:33.747739 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9e52a7d3-6e08-4f1a-be09-a24b8612caa8 could not be found. Jun 14 18:35:33.747739 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:35:33.747739 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-b3db29e2-c29a-4956-b06a-1adccc5ab8bf tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] Returning 404 to user: Volume 9e52a7d3-6e08-4f1a-be09-a24b8612caa8 could not be found. {{(pid=118624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:35:33.747739 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-b3db29e2-c29a-4956-b06a-1adccc5ab8bf tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/9e52a7d3-6e08-4f1a-be09-a24b8612caa8" status: 404 len: 109 microversion: 2.1 time: 0.037332 Jun 14 18:35:33.747739 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 501/974] 10.222.0.78 () {58 vars in 1247 bytes} [Tue Jun 14 18:35:33 2022] DELETE /compute/v2.1/os-volumes/9e52a7d3-6e08-4f1a-be09-a24b8612caa8 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:35:33.748845 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-c4c42f6b-890b-4876-bc5b-4712cf4be42e tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] Calling method '.version_select at 0x7efe7154dee0>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:33.776104 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.wsgi [None req-c4c42f6b-890b-4876-bc5b-4712cf4be42e tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] HTTP exception thrown: Volume 9e52a7d3-6e08-4f1a-be09-a24b8612caa8 could not be found. Jun 14 18:35:33.778293 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-c4c42f6b-890b-4876-bc5b-4712cf4be42e tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] Request method failure captured: Jun 14 18:35:33.778293 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: request: GET /compute/v2.1/os-volumes/9e52a7d3-6e08-4f1a-be09-a24b8612caa8 HTTP/1.1 Jun 14 18:35:33.778293 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept: application/json Jun 14 18:35:33.778293 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept-Encoding: identity Jun 14 18:35:33.778293 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Connection: close Jun 14 18:35:33.778293 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Length: 0 Jun 14 18:35:33.778293 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Type: application/json Jun 14 18:35:33.778293 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Host: 10.222.0.78 Jun 14 18:35:33.778293 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Openstack-System-Scope: None Jun 14 18:35:33.778293 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: User-Agent: python-urllib3/1.26.9 Jun 14 18:35:33.778293 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Auth-Token: gAAAAABiqNTsB2U_srPATM1oP2AGxLZw4pPJPnFARcHoFkGWj7zdRh7pKuJEPrhQCBER4eCArLdKdCGnWbTB31Ytkmrd4ghQ99HljKagF7Rmoqv1_1f2hqyFN8LnAkc07Xn9gkqVvwFkyp0iNo8GZwnOmQqXVBkRhDnGRrETyr3wOgJW-ZV-M94 Jun 14 18:35:33.778293 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Id: None Jun 14 18:35:33.778293 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Name: None Jun 14 18:35:33.778293 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Identity-Status: Confirmed Jun 14 18:35:33.778293 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Is-Admin-Project: True Jun 14 18:35:33.778293 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Id: default Jun 14 18:35:33.778293 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Name: Default Jun 14 18:35:33.778293 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Id: fb38b7fc4f81427a9ce03e1adc64a7c9 Jun 14 18:35:33.778293 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1168419935 Jun 14 18:35:33.778293 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Role: reader,member Jun 14 18:35:33.778293 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Roles: reader,member Jun 14 18:35:33.780108 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_fb38b7fc4f81427a9ce03e1adc64a7c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fb38b7fc4f81427a9ce03e1adc64a7c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fb38b7fc4f81427a9ce03e1adc64a7c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/fb38b7fc4f81427a9ce03e1adc64a7c9"}]}] Jun 14 18:35:33.780108 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1168419935 Jun 14 18:35:33.780108 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Id: fb38b7fc4f81427a9ce03e1adc64a7c9 Jun 14 18:35:33.780108 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1168419935 Jun 14 18:35:33.780108 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User: tempest-VolumesSnapshotsTestJSON-1168419935-project Jun 14 18:35:33.780108 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Id: default Jun 14 18:35:33.780108 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Name: Default Jun 14 18:35:33.780108 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Id: c804343e481d4bb297f1a14a289dac99 Jun 14 18:35:33.780108 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1168419935-project Jun 14 18:35:33.780108 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: method: Jun 14 18:35:33.780108 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: exception: Volume 9e52a7d3-6e08-4f1a-be09-a24b8612caa8 could not be found. Jun 14 18:35:33.780108 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: action_args: {'id': '9e52a7d3-6e08-4f1a-be09-a24b8612caa8'} Jun 14 18:35:33.780108 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:35:33.783732 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:33.783732 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 14 18:35:33.783732 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 14 18:35:33.783732 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 14 18:35:33.783732 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 14 18:35:33.783732 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 14 18:35:33.783732 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 14 18:35:33.783732 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 14 18:35:33.783732 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 14 18:35:33.783732 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 14 18:35:33.783732 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 14 18:35:33.783732 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 18:35:33.783732 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 18:35:33.783732 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 18:35:33.783732 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 18:35:33.783732 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9e52a7d3-6e08-4f1a-be09-a24b8612caa8 could not be found. (HTTP 404) (Request-ID: req-678cde89-be87-4d34-80e6-45f2b4893cb3) Jun 14 18:35:33.783732 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:33.783732 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:35:33.783732 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:33.785057 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:33.785057 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 14 18:35:33.785057 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 14 18:35:33.785057 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 14 18:35:33.785057 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 14 18:35:33.785057 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 14 18:35:33.785057 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 14 18:35:33.785057 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 14 18:35:33.785057 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 14 18:35:33.785057 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 14 18:35:33.785057 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 14 18:35:33.785057 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 14 18:35:33.785057 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 14 18:35:33.785057 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 14 18:35:33.785057 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 14 18:35:33.785057 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 14 18:35:33.785057 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 14 18:35:33.785057 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 14 18:35:33.785057 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 14 18:35:33.787002 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 18:35:33.787002 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 18:35:33.787002 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 18:35:33.787002 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 18:35:33.787002 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9e52a7d3-6e08-4f1a-be09-a24b8612caa8 could not be found. Jun 14 18:35:33.787002 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:33.787002 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:35:33.787002 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:33.787002 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:33.787002 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:35:33.787002 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:35:33.787002 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:35:33.787002 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:35:33.787002 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 14 18:35:33.787002 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 14 18:35:33.787002 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:35:33.787002 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:35:33.787002 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 14 18:35:33.787002 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:35:33.788224 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9e52a7d3-6e08-4f1a-be09-a24b8612caa8 could not be found. Jun 14 18:35:33.788224 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:33.788224 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:35:33.788224 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:33.788224 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:33.788224 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:35:33.788224 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:35:33.788224 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:35:33.788224 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:35:33.788224 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9e52a7d3-6e08-4f1a-be09-a24b8612caa8 could not be found. Jun 14 18:35:33.788224 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:33.788224 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-c4c42f6b-890b-4876-bc5b-4712cf4be42e tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] Returning 404 to user: Volume 9e52a7d3-6e08-4f1a-be09-a24b8612caa8 could not be found. {{(pid=118623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:35:33.788224 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-c4c42f6b-890b-4876-bc5b-4712cf4be42e tempest-VolumesSnapshotsTestJSON-1168419935 tempest-VolumesSnapshotsTestJSON-1168419935-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/9e52a7d3-6e08-4f1a-be09-a24b8612caa8" status: 404 len: 109 microversion: 2.1 time: 0.037781 Jun 14 18:35:33.788224 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 474/975] 10.222.0.78 () {58 vars in 1244 bytes} [Tue Jun 14 18:35:33 2022] GET /compute/v2.1/os-volumes/9e52a7d3-6e08-4f1a-be09-a24b8612caa8 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:35:34.013041 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-4654bed5-3546-4455-ab0b-063e5b7b1bba req-2f43f435-35a4-4690-a537-69945d53ed20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2731df7-b150-4a46-830e-90cb335e2c77", "tag": "a7a06548-d4c6-41ab-a15e-ae486056e452"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:35:34.023366 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-4654bed5-3546-4455-ab0b-063e5b7b1bba req-2f43f435-35a4-4690-a537-69945d53ed20 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:34.023801 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-4654bed5-3546-4455-ab0b-063e5b7b1bba req-2f43f435-35a4-4690-a537-69945d53ed20 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:34.036365 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-4654bed5-3546-4455-ab0b-063e5b7b1bba req-2f43f435-35a4-4690-a537-69945d53ed20 service nova] Creating event network-changed:a7a06548-d4c6-41ab-a15e-ae486056e452 for instance b2731df7-b150-4a46-830e-90cb335e2c77 on hv-cinder-84456 Jun 14 18:35:34.041384 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-4654bed5-3546-4455-ab0b-063e5b7b1bba req-2f43f435-35a4-4690-a537-69945d53ed20 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033155 Jun 14 18:35:34.042027 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 502/976] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:35:34.201214 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-44ec631d-0cc0-4309-b063-16452e945520 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:34.201862 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-44ec631d-0cc0-4309-b063-16452e945520 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] [instance: b2731df7-b150-4a46-830e-90cb335e2c77] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:34.204857 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:35:34.210091 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-44ec631d-0cc0-4309-b063-16452e945520 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:34.210680 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-44ec631d-0cc0-4309-b063-16452e945520 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:34.211466 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-44ec631d-0cc0-4309-b063-16452e945520 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:34.211898 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-44ec631d-0cc0-4309-b063-16452e945520 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:34.217142 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:35:34.426422 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-44ec631d-0cc0-4309-b063-16452e945520 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5d400872474e619ec7b97724021e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea5688a5de847c7bb66afa3c46c759a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:35:34.440572 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-44ec631d-0cc0-4309-b063-16452e945520 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] 10.222.0.78 "GET /compute/v2.1/servers/b2731df7-b150-4a46-830e-90cb335e2c77" status: 200 len: 1314 microversion: 2.1 time: 0.241010 Jun 14 18:35:34.440572 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 475/977] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:34 2022] GET /compute/v2.1/servers/b2731df7-b150-4a46-830e-90cb335e2c77 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:35:35.461023 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-39b86802-956b-41c0-a12f-0d0dbd93b411 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:35.466461 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-39b86802-956b-41c0-a12f-0d0dbd93b411 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] [instance: b2731df7-b150-4a46-830e-90cb335e2c77] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:35.466461 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=2 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:35:35.471967 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-39b86802-956b-41c0-a12f-0d0dbd93b411 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:35.472438 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-39b86802-956b-41c0-a12f-0d0dbd93b411 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:35.473197 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-39b86802-956b-41c0-a12f-0d0dbd93b411 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:35.473656 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-39b86802-956b-41c0-a12f-0d0dbd93b411 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:35.672140 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-39b86802-956b-41c0-a12f-0d0dbd93b411 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5d400872474e619ec7b97724021e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea5688a5de847c7bb66afa3c46c759a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:35:35.680992 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-39b86802-956b-41c0-a12f-0d0dbd93b411 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] 10.222.0.78 "GET /compute/v2.1/servers/b2731df7-b150-4a46-830e-90cb335e2c77" status: 200 len: 1314 microversion: 2.1 time: 0.227201 Jun 14 18:35:35.691443 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 503/978] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:35 2022] GET /compute/v2.1/servers/b2731df7-b150-4a46-830e-90cb335e2c77 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:35:36.699780 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-6727f31b-eafb-4772-9057-31c1f5f919c8 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:36.701147 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-6727f31b-eafb-4772-9057-31c1f5f919c8 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] [instance: b2731df7-b150-4a46-830e-90cb335e2c77] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:36.712584 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6727f31b-eafb-4772-9057-31c1f5f919c8 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:36.713259 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6727f31b-eafb-4772-9057-31c1f5f919c8 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:36.714186 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6727f31b-eafb-4772-9057-31c1f5f919c8 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:36.714832 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-6727f31b-eafb-4772-9057-31c1f5f919c8 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:36.862607 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-6727f31b-eafb-4772-9057-31c1f5f919c8 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5d400872474e619ec7b97724021e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea5688a5de847c7bb66afa3c46c759a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:35:36.871545 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-6727f31b-eafb-4772-9057-31c1f5f919c8 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] 10.222.0.78 "GET /compute/v2.1/servers/b2731df7-b150-4a46-830e-90cb335e2c77" status: 200 len: 1314 microversion: 2.1 time: 0.175206 Jun 14 18:35:36.881180 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 476/979] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:36 2022] GET /compute/v2.1/servers/b2731df7-b150-4a46-830e-90cb335e2c77 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:35:37.889664 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-ae315ce0-e9a1-4b10-a630-aeae2fa2db3a tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:37.890332 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-ae315ce0-e9a1-4b10-a630-aeae2fa2db3a tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] [instance: b2731df7-b150-4a46-830e-90cb335e2c77] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:37.897646 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ae315ce0-e9a1-4b10-a630-aeae2fa2db3a tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:37.898094 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ae315ce0-e9a1-4b10-a630-aeae2fa2db3a tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:37.898854 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ae315ce0-e9a1-4b10-a630-aeae2fa2db3a tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:37.899454 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ae315ce0-e9a1-4b10-a630-aeae2fa2db3a tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:38.059317 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-ae315ce0-e9a1-4b10-a630-aeae2fa2db3a tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5d400872474e619ec7b97724021e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea5688a5de847c7bb66afa3c46c759a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:35:38.066880 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-ae315ce0-e9a1-4b10-a630-aeae2fa2db3a tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] 10.222.0.78 "GET /compute/v2.1/servers/b2731df7-b150-4a46-830e-90cb335e2c77" status: 200 len: 1314 microversion: 2.1 time: 0.182448 Jun 14 18:35:38.067443 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 504/980] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:37 2022] GET /compute/v2.1/servers/b2731df7-b150-4a46-830e-90cb335e2c77 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:35:39.085265 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-b82c5cd0-d3ee-4424-ae53-326c4d84d1ab tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:39.085869 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-b82c5cd0-d3ee-4424-ae53-326c4d84d1ab tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] [instance: b2731df7-b150-4a46-830e-90cb335e2c77] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:39.091062 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell0:SELECT=2 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:35:39.092030 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell0:SELECT=6 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:35:39.097436 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b82c5cd0-d3ee-4424-ae53-326c4d84d1ab tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:39.097908 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b82c5cd0-d3ee-4424-ae53-326c4d84d1ab tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:39.099001 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b82c5cd0-d3ee-4424-ae53-326c4d84d1ab tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:39.099437 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b82c5cd0-d3ee-4424-ae53-326c4d84d1ab tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:39.263189 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-b82c5cd0-d3ee-4424-ae53-326c4d84d1ab tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5d400872474e619ec7b97724021e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea5688a5de847c7bb66afa3c46c759a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:35:39.272810 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-b82c5cd0-d3ee-4424-ae53-326c4d84d1ab tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] 10.222.0.78 "GET /compute/v2.1/servers/b2731df7-b150-4a46-830e-90cb335e2c77" status: 200 len: 1314 microversion: 2.1 time: 0.192000 Jun 14 18:35:39.274008 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 477/981] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:39 2022] GET /compute/v2.1/servers/b2731df7-b150-4a46-830e-90cb335e2c77 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:35:40.291687 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-6caaade4-b980-4f26-9c67-d02c9a098eb4 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:40.292306 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-6caaade4-b980-4f26-9c67-d02c9a098eb4 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] [instance: b2731df7-b150-4a46-830e-90cb335e2c77] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:40.295123 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell0:SELECT=4 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:35:40.300241 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6caaade4-b980-4f26-9c67-d02c9a098eb4 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:40.300694 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6caaade4-b980-4f26-9c67-d02c9a098eb4 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:40.301617 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6caaade4-b980-4f26-9c67-d02c9a098eb4 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:40.302089 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6caaade4-b980-4f26-9c67-d02c9a098eb4 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:40.451172 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-6caaade4-b980-4f26-9c67-d02c9a098eb4 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5d400872474e619ec7b97724021e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea5688a5de847c7bb66afa3c46c759a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:35:40.459997 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-6caaade4-b980-4f26-9c67-d02c9a098eb4 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] 10.222.0.78 "GET /compute/v2.1/servers/b2731df7-b150-4a46-830e-90cb335e2c77" status: 200 len: 1314 microversion: 2.1 time: 0.172296 Jun 14 18:35:40.460574 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 505/982] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:40 2022] GET /compute/v2.1/servers/b2731df7-b150-4a46-830e-90cb335e2c77 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:35:40.776229 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-77f06f93-ad5e-49cc-afcb-cc867b435ea2 req-90e70435-b1da-4f93-9d7d-338a481054b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2731df7-b150-4a46-830e-90cb335e2c77", "name": "network-vif-plugged", "status": "completed", "tag": "a7a06548-d4c6-41ab-a15e-ae486056e452"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:35:40.787398 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-77f06f93-ad5e-49cc-afcb-cc867b435ea2 req-90e70435-b1da-4f93-9d7d-338a481054b1 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:40.787833 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-77f06f93-ad5e-49cc-afcb-cc867b435ea2 req-90e70435-b1da-4f93-9d7d-338a481054b1 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:40.799436 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-77f06f93-ad5e-49cc-afcb-cc867b435ea2 req-90e70435-b1da-4f93-9d7d-338a481054b1 service nova] Creating event network-vif-plugged:a7a06548-d4c6-41ab-a15e-ae486056e452 for instance b2731df7-b150-4a46-830e-90cb335e2c77 on hv-cinder-84456 Jun 14 18:35:40.804444 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-77f06f93-ad5e-49cc-afcb-cc867b435ea2 req-90e70435-b1da-4f93-9d7d-338a481054b1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033190 Jun 14 18:35:40.805011 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 478/983] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:35:41.478008 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-70e00e74-d04c-4113-8b72-82fc1a07c918 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:41.478536 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-70e00e74-d04c-4113-8b72-82fc1a07c918 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] [instance: b2731df7-b150-4a46-830e-90cb335e2c77] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:41.485854 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-70e00e74-d04c-4113-8b72-82fc1a07c918 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:41.486315 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-70e00e74-d04c-4113-8b72-82fc1a07c918 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:41.488922 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-70e00e74-d04c-4113-8b72-82fc1a07c918 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:41.488922 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-70e00e74-d04c-4113-8b72-82fc1a07c918 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:41.627900 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-70e00e74-d04c-4113-8b72-82fc1a07c918 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5d400872474e619ec7b97724021e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea5688a5de847c7bb66afa3c46c759a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:35:41.635352 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-70e00e74-d04c-4113-8b72-82fc1a07c918 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] 10.222.0.78 "GET /compute/v2.1/servers/b2731df7-b150-4a46-830e-90cb335e2c77" status: 200 len: 1314 microversion: 2.1 time: 0.161839 Jun 14 18:35:41.635913 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 506/984] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:41 2022] GET /compute/v2.1/servers/b2731df7-b150-4a46-830e-90cb335e2c77 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:35:42.656347 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-8afc0835-3824-4738-8fab-a75ff0f9b385 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:42.657047 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-8afc0835-3824-4738-8fab-a75ff0f9b385 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] [instance: b2731df7-b150-4a46-830e-90cb335e2c77] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:42.664159 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8afc0835-3824-4738-8fab-a75ff0f9b385 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:42.664612 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8afc0835-3824-4738-8fab-a75ff0f9b385 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:42.665369 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8afc0835-3824-4738-8fab-a75ff0f9b385 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:42.665831 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8afc0835-3824-4738-8fab-a75ff0f9b385 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:42.812494 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-8afc0835-3824-4738-8fab-a75ff0f9b385 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5d400872474e619ec7b97724021e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea5688a5de847c7bb66afa3c46c759a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:35:42.821281 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-8afc0835-3824-4738-8fab-a75ff0f9b385 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] 10.222.0.78 "GET /compute/v2.1/servers/b2731df7-b150-4a46-830e-90cb335e2c77" status: 200 len: 1497 microversion: 2.1 time: 0.169328 Jun 14 18:35:42.821889 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 479/985] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:42 2022] GET /compute/v2.1/servers/b2731df7-b150-4a46-830e-90cb335e2c77 => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:35:43.696159 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-8cfb26ba-4a94-44f2-85b9-872cce75dda2 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:43.696736 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-8cfb26ba-4a94-44f2-85b9-872cce75dda2 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] [instance: b2731df7-b150-4a46-830e-90cb335e2c77] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:43.704036 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8cfb26ba-4a94-44f2-85b9-872cce75dda2 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:43.704490 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8cfb26ba-4a94-44f2-85b9-872cce75dda2 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:43.705277 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8cfb26ba-4a94-44f2-85b9-872cce75dda2 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:43.705740 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8cfb26ba-4a94-44f2-85b9-872cce75dda2 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:43.731863 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-8cfb26ba-4a94-44f2-85b9-872cce75dda2 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] [instance: b2731df7-b150-4a46-830e-90cb335e2c77] Going to try to terminate instance {{(pid=118624) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:35:44.079616 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-8cfb26ba-4a94-44f2-85b9-872cce75dda2 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b2731df7-b150-4a46-830e-90cb335e2c77" status: 204 len: 0 microversion: 2.1 time: 0.387165 Jun 14 18:35:44.080203 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 507/986] 10.222.0.78 () {58 vars in 1238 bytes} [Tue Jun 14 18:35:43 2022] DELETE /compute/v2.1/servers/b2731df7-b150-4a46-830e-90cb335e2c77 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 18:35:44.094421 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-433af119-878a-4b10-830b-19361e65a98c tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:44.095025 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-433af119-878a-4b10-830b-19361e65a98c tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] [instance: b2731df7-b150-4a46-830e-90cb335e2c77] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:44.101437 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-433af119-878a-4b10-830b-19361e65a98c tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:44.101911 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-433af119-878a-4b10-830b-19361e65a98c tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:44.102667 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-433af119-878a-4b10-830b-19361e65a98c tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:44.103097 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-433af119-878a-4b10-830b-19361e65a98c tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:44.235845 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-433af119-878a-4b10-830b-19361e65a98c tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5d400872474e619ec7b97724021e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea5688a5de847c7bb66afa3c46c759a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:35:44.243244 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-433af119-878a-4b10-830b-19361e65a98c tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] 10.222.0.78 "GET /compute/v2.1/servers/b2731df7-b150-4a46-830e-90cb335e2c77" status: 200 len: 1503 microversion: 2.1 time: 0.152839 Jun 14 18:35:44.243808 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 480/987] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:44 2022] GET /compute/v2.1/servers/b2731df7-b150-4a46-830e-90cb335e2c77 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:35:45.260601 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-3fc2efca-2932-4cdb-995b-388348b98c50 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:45.262038 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-3fc2efca-2932-4cdb-995b-388348b98c50 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] [instance: b2731df7-b150-4a46-830e-90cb335e2c77] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:45.268889 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3fc2efca-2932-4cdb-995b-388348b98c50 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:45.269321 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3fc2efca-2932-4cdb-995b-388348b98c50 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:45.270154 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3fc2efca-2932-4cdb-995b-388348b98c50 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:45.270586 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3fc2efca-2932-4cdb-995b-388348b98c50 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:45.424982 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-3fc2efca-2932-4cdb-995b-388348b98c50 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5d400872474e619ec7b97724021e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea5688a5de847c7bb66afa3c46c759a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:35:45.433511 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-3fc2efca-2932-4cdb-995b-388348b98c50 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] 10.222.0.78 "GET /compute/v2.1/servers/b2731df7-b150-4a46-830e-90cb335e2c77" status: 200 len: 1503 microversion: 2.1 time: 0.176992 Jun 14 18:35:45.434626 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 508/988] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:45 2022] GET /compute/v2.1/servers/b2731df7-b150-4a46-830e-90cb335e2c77 => generated 1503 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:35:45.940373 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-4091b8d7-b571-4938-b192-2044ba5cdd32 req-f937d8e2-eb06-4d76-87e1-21bfd2885367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2731df7-b150-4a46-830e-90cb335e2c77", "name": "network-vif-deleted", "tag": "a7a06548-d4c6-41ab-a15e-ae486056e452"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:35:45.951383 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-4091b8d7-b571-4938-b192-2044ba5cdd32 req-f937d8e2-eb06-4d76-87e1-21bfd2885367 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:45.951953 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-4091b8d7-b571-4938-b192-2044ba5cdd32 req-f937d8e2-eb06-4d76-87e1-21bfd2885367 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:45.964161 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-4091b8d7-b571-4938-b192-2044ba5cdd32 req-f937d8e2-eb06-4d76-87e1-21bfd2885367 service nova] Creating event network-vif-deleted:a7a06548-d4c6-41ab-a15e-ae486056e452 for instance b2731df7-b150-4a46-830e-90cb335e2c77 on hv-cinder-84456 Jun 14 18:35:45.969963 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-4091b8d7-b571-4938-b192-2044ba5cdd32 req-f937d8e2-eb06-4d76-87e1-21bfd2885367 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033851 Jun 14 18:35:45.970550 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 481/989] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:35:46.451962 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-2212f19e-1283-40dd-95de-afde0c3c4810 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:46.453279 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-2212f19e-1283-40dd-95de-afde0c3c4810 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] [instance: b2731df7-b150-4a46-830e-90cb335e2c77] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:46.467715 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2212f19e-1283-40dd-95de-afde0c3c4810 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:46.467715 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2212f19e-1283-40dd-95de-afde0c3c4810 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:46.467715 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2212f19e-1283-40dd-95de-afde0c3c4810 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:46.467715 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2212f19e-1283-40dd-95de-afde0c3c4810 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:46.501629 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2212f19e-1283-40dd-95de-afde0c3c4810 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:46.502641 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2212f19e-1283-40dd-95de-afde0c3c4810 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:46.503216 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.objects.instance [None req-2212f19e-1283-40dd-95de-afde0c3c4810 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lazy-loading 'fault' on Instance uuid b2731df7-b150-4a46-830e-90cb335e2c77 {{(pid=118624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:35:46.552364 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-2212f19e-1283-40dd-95de-afde0c3c4810 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5d400872474e619ec7b97724021e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea5688a5de847c7bb66afa3c46c759a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:35:46.563281 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-2212f19e-1283-40dd-95de-afde0c3c4810 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] 10.222.0.78 "GET /compute/v2.1/servers/b2731df7-b150-4a46-830e-90cb335e2c77" status: 200 len: 1304 microversion: 2.1 time: 0.116128 Jun 14 18:35:46.564179 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 509/990] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:46 2022] GET /compute/v2.1/servers/b2731df7-b150-4a46-830e-90cb335e2c77 => generated 1304 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:35:47.582056 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-0894d65f-91ea-41f3-b29e-b1648e3144f5 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:47.582739 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-0894d65f-91ea-41f3-b29e-b1648e3144f5 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] [instance: b2731df7-b150-4a46-830e-90cb335e2c77] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:47.588778 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0894d65f-91ea-41f3-b29e-b1648e3144f5 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:47.589223 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0894d65f-91ea-41f3-b29e-b1648e3144f5 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:47.590438 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0894d65f-91ea-41f3-b29e-b1648e3144f5 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:47.590796 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-0894d65f-91ea-41f3-b29e-b1648e3144f5 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:47.603987 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.wsgi [None req-0894d65f-91ea-41f3-b29e-b1648e3144f5 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] HTTP exception thrown: Instance b2731df7-b150-4a46-830e-90cb335e2c77 could not be found. Jun 14 18:35:47.606146 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-0894d65f-91ea-41f3-b29e-b1648e3144f5 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Request method failure captured: Jun 14 18:35:47.606146 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: request: GET /compute/v2.1/servers/b2731df7-b150-4a46-830e-90cb335e2c77 HTTP/1.1 Jun 14 18:35:47.606146 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept: application/json Jun 14 18:35:47.606146 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept-Encoding: identity Jun 14 18:35:47.606146 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Connection: close Jun 14 18:35:47.606146 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Length: 0 Jun 14 18:35:47.606146 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Type: application/json Jun 14 18:35:47.606146 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Host: 10.222.0.78 Jun 14 18:35:47.606146 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Openstack-System-Scope: None Jun 14 18:35:47.606146 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: User-Agent: python-urllib3/1.26.9 Jun 14 18:35:47.606146 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Auth-Token: gAAAAABiqNTsgoubIkBghQaMLkiEpjAKNnk29DqXLkUndEYW2dwqupSiHZX2PCTkK-eawW430lGQJQ5huXz6y6yJrxEeQQwt4X2Ff-E_B2lPB7ecpocK2tdpDVvL6epxGaPS4R2NfIpnUujHZqwAkKaj79EQ-MFg4saW4tcGGD7gp6vZpx9_LfM Jun 14 18:35:47.606146 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Id: None Jun 14 18:35:47.606146 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Name: None Jun 14 18:35:47.606146 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Identity-Status: Confirmed Jun 14 18:35:47.606146 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Is-Admin-Project: True Jun 14 18:35:47.606146 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Id: default Jun 14 18:35:47.606146 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Name: Default Jun 14 18:35:47.606146 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Id: eea5688a5de847c7bb66afa3c46c759a Jun 14 18:35:47.606146 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Name: tempest-VolumesActionsTest-272654221 Jun 14 18:35:47.606146 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Role: reader,member Jun 14 18:35:47.606146 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Roles: reader,member Jun 14 18:35:47.607798 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_eea5688a5de847c7bb66afa3c46c759a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/eea5688a5de847c7bb66afa3c46c759a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/eea5688a5de847c7bb66afa3c46c759a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/eea5688a5de847c7bb66afa3c46c759a"}]}] Jun 14 18:35:47.607798 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant: tempest-VolumesActionsTest-272654221 Jun 14 18:35:47.607798 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Id: eea5688a5de847c7bb66afa3c46c759a Jun 14 18:35:47.607798 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Name: tempest-VolumesActionsTest-272654221 Jun 14 18:35:47.607798 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User: tempest-VolumesActionsTest-272654221-project Jun 14 18:35:47.607798 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Id: default Jun 14 18:35:47.607798 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Name: Default Jun 14 18:35:47.607798 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Id: 7e5d400872474e619ec7b97724021e25 Jun 14 18:35:47.607798 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Name: tempest-VolumesActionsTest-272654221-project Jun 14 18:35:47.607798 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: method: > Jun 14 18:35:47.607798 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: exception: Instance b2731df7-b150-4a46-830e-90cb335e2c77 could not be found. Jun 14 18:35:47.607798 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: action_args: {'id': 'b2731df7-b150-4a46-830e-90cb335e2c77'} Jun 14 18:35:47.608681 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:35:47.608681 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:47.608681 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:35:47.608681 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:35:47.608681 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:35:47.608681 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:35:47.608681 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:35:47.608681 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:35:47.608681 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:35:47.608681 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:35:47.608681 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2731df7-b150-4a46-830e-90cb335e2c77 could not be found. Jun 14 18:35:47.608681 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:47.608681 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:35:47.608681 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:47.608681 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:47.608681 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:35:47.608681 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:35:47.608681 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:35:47.608681 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:35:47.608681 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:35:47.610283 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:35:47.610283 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:35:47.610283 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:35:47.610283 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:35:47.610283 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:35:47.610283 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:35:47.610283 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:35:47.610283 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2731df7-b150-4a46-830e-90cb335e2c77 could not be found. Jun 14 18:35:47.610283 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:47.610283 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:35:47.610283 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:47.610283 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:35:47.610283 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:35:47.610283 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:35:47.610283 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:35:47.610283 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:35:47.610283 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2731df7-b150-4a46-830e-90cb335e2c77 could not be found. Jun 14 18:35:47.610283 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:35:47.611639 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-0894d65f-91ea-41f3-b29e-b1648e3144f5 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Returning 404 to user: Instance b2731df7-b150-4a46-830e-90cb335e2c77 could not be found. {{(pid=118623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:35:47.611639 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-0894d65f-91ea-41f3-b29e-b1648e3144f5 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] 10.222.0.78 "GET /compute/v2.1/servers/b2731df7-b150-4a46-830e-90cb335e2c77" status: 404 len: 111 microversion: 2.1 time: 0.030197 Jun 14 18:35:47.611639 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 482/991] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:47 2022] GET /compute/v2.1/servers/b2731df7-b150-4a46-830e-90cb335e2c77 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:35:47.708079 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-34dfdce7-7d3d-4353-9634-2f66620860f0 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-615232795", "imageRef": "e2555120-8576-4128-944f-40805aa95a9b", "flavorRef": "452", "networks": [{"uuid": "91c5a939-2b5d-4f8f-b89e-1ae52321b35f"}]}} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:35:47.761574 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.network.neutron [None req-34dfdce7-7d3d-4353-9634-2f66620860f0 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] validate_networks() for [('91c5a939-2b5d-4f8f-b89e-1ae52321b35f', None, None, None, None, None)] {{(pid=118624) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 18:35:48.116271 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-34dfdce7-7d3d-4353-9634-2f66620860f0 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Flavor limits 0:0:0 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 18:35:48.116946 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-34dfdce7-7d3d-4353-9634-2f66620860f0 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Image limits 0:0:0 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 18:35:48.117548 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-34dfdce7-7d3d-4353-9634-2f66620860f0 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Flavor pref 0:0:0 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 18:35:48.118143 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-34dfdce7-7d3d-4353-9634-2f66620860f0 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Image pref 0:0:0 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 18:35:48.118552 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-34dfdce7-7d3d-4353-9634-2f66620860f0 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 18:35:48.128007 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-34dfdce7-7d3d-4353-9634-2f66620860f0 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:48.128364 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-34dfdce7-7d3d-4353-9634-2f66620860f0 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:48.129385 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-34dfdce7-7d3d-4353-9634-2f66620860f0 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:48.129667 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-34dfdce7-7d3d-4353-9634-2f66620860f0 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:48.147587 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.quota [None req-34dfdce7-7d3d-4353-9634-2f66620860f0 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Getting quotas for project eea5688a5de847c7bb66afa3c46c759a. Resources: {'instances', 'cores', 'ram'} {{(pid=118624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:35:48.151572 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.quota [None req-34dfdce7-7d3d-4353-9634-2f66620860f0 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Getting quotas for user 7e5d400872474e619ec7b97724021e25 and project eea5688a5de847c7bb66afa3c46c759a. Resources: {'instances', 'cores', 'ram'} {{(pid=118624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:35:48.163211 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-34dfdce7-7d3d-4353-9634-2f66620860f0 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Going to run 1 instances... {{(pid=118624) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 18:35:48.165481 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-34dfdce7-7d3d-4353-9634-2f66620860f0 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] [instance: 78e9def8-e7ca-4c8e-b83f-f43a93eda200] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e2555120-8576-4128-944f-40805aa95a9b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118624) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 18:35:48.340077 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-34dfdce7-7d3d-4353-9634-2f66620860f0 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.635966 Jun 14 18:35:48.340740 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 510/992] 10.222.0.78 () {60 vars in 1146 bytes} [Tue Jun 14 18:35:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 18:35:48.350957 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-5ba3242a-5c17-4a94-b4e4-de835272d794 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:48.351598 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-5ba3242a-5c17-4a94-b4e4-de835272d794 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] [instance: 78e9def8-e7ca-4c8e-b83f-f43a93eda200] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:48.417731 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-5ba3242a-5c17-4a94-b4e4-de835272d794 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5d400872474e619ec7b97724021e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea5688a5de847c7bb66afa3c46c759a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:35:48.418317 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-5ba3242a-5c17-4a94-b4e4-de835272d794 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] 10.222.0.78 "GET /compute/v2.1/servers/78e9def8-e7ca-4c8e-b83f-f43a93eda200" status: 200 len: 1213 microversion: 2.1 time: 0.071068 Jun 14 18:35:48.419106 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 483/993] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:48 2022] GET /compute/v2.1/servers/78e9def8-e7ca-4c8e-b83f-f43a93eda200 => generated 1213 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:35:49.437057 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-4ab03149-fb74-4cb9-84c7-0e96d09a066c tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:49.437705 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-4ab03149-fb74-4cb9-84c7-0e96d09a066c tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] [instance: 78e9def8-e7ca-4c8e-b83f-f43a93eda200] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:49.444745 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4ab03149-fb74-4cb9-84c7-0e96d09a066c tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:49.445201 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4ab03149-fb74-4cb9-84c7-0e96d09a066c tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:49.446010 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4ab03149-fb74-4cb9-84c7-0e96d09a066c tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:49.446450 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4ab03149-fb74-4cb9-84c7-0e96d09a066c tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:49.510254 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-4ab03149-fb74-4cb9-84c7-0e96d09a066c tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5d400872474e619ec7b97724021e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea5688a5de847c7bb66afa3c46c759a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:35:49.517967 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-4ab03149-fb74-4cb9-84c7-0e96d09a066c tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] 10.222.0.78 "GET /compute/v2.1/servers/78e9def8-e7ca-4c8e-b83f-f43a93eda200" status: 200 len: 1217 microversion: 2.1 time: 0.085921 Jun 14 18:35:49.520456 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 511/994] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:49 2022] GET /compute/v2.1/servers/78e9def8-e7ca-4c8e-b83f-f43a93eda200 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:35:50.535945 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-b4e2d05e-dc40-4fb1-b04a-e0fa24bf1867 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:50.536606 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-b4e2d05e-dc40-4fb1-b04a-e0fa24bf1867 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] [instance: 78e9def8-e7ca-4c8e-b83f-f43a93eda200] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:50.544575 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b4e2d05e-dc40-4fb1-b04a-e0fa24bf1867 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:50.545022 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b4e2d05e-dc40-4fb1-b04a-e0fa24bf1867 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:50.545814 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b4e2d05e-dc40-4fb1-b04a-e0fa24bf1867 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:50.546314 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b4e2d05e-dc40-4fb1-b04a-e0fa24bf1867 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:50.612152 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-b4e2d05e-dc40-4fb1-b04a-e0fa24bf1867 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5d400872474e619ec7b97724021e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea5688a5de847c7bb66afa3c46c759a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:35:50.616450 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-b4e2d05e-dc40-4fb1-b04a-e0fa24bf1867 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] 10.222.0.78 "GET /compute/v2.1/servers/78e9def8-e7ca-4c8e-b83f-f43a93eda200" status: 200 len: 1265 microversion: 2.1 time: 0.084707 Jun 14 18:35:50.617104 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 484/995] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:50 2022] GET /compute/v2.1/servers/78e9def8-e7ca-4c8e-b83f-f43a93eda200 => generated 1265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:35:51.635354 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-e15ab977-d597-45fd-a53d-9540939219e8 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:51.635829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-e15ab977-d597-45fd-a53d-9540939219e8 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] [instance: 78e9def8-e7ca-4c8e-b83f-f43a93eda200] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:51.643022 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e15ab977-d597-45fd-a53d-9540939219e8 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:51.643581 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e15ab977-d597-45fd-a53d-9540939219e8 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:51.644321 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e15ab977-d597-45fd-a53d-9540939219e8 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:51.644725 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e15ab977-d597-45fd-a53d-9540939219e8 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:51.715945 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-e15ab977-d597-45fd-a53d-9540939219e8 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5d400872474e619ec7b97724021e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea5688a5de847c7bb66afa3c46c759a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:35:51.732407 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-e15ab977-d597-45fd-a53d-9540939219e8 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] 10.222.0.78 "GET /compute/v2.1/servers/78e9def8-e7ca-4c8e-b83f-f43a93eda200" status: 200 len: 1271 microversion: 2.1 time: 0.101005 Jun 14 18:35:51.732998 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 512/996] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:51 2022] GET /compute/v2.1/servers/78e9def8-e7ca-4c8e-b83f-f43a93eda200 => generated 1271 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:35:52.750681 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-56d5f19e-c121-4d9a-a64d-fbe04a0c7309 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:52.751365 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-56d5f19e-c121-4d9a-a64d-fbe04a0c7309 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] [instance: 78e9def8-e7ca-4c8e-b83f-f43a93eda200] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:52.757676 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-56d5f19e-c121-4d9a-a64d-fbe04a0c7309 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:52.758117 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-56d5f19e-c121-4d9a-a64d-fbe04a0c7309 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:52.758873 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-56d5f19e-c121-4d9a-a64d-fbe04a0c7309 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:52.759298 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-56d5f19e-c121-4d9a-a64d-fbe04a0c7309 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:52.828380 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-5a53a5b4-87b9-4f97-896e-292ca71f7e13 req-b55c4393-a9f6-4305-9398-3885d256003c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78e9def8-e7ca-4c8e-b83f-f43a93eda200", "tag": "4326f4db-e37d-41b3-b103-744b4119c2d0"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:35:52.837785 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-5a53a5b4-87b9-4f97-896e-292ca71f7e13 req-b55c4393-a9f6-4305-9398-3885d256003c service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:52.838472 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-5a53a5b4-87b9-4f97-896e-292ca71f7e13 req-b55c4393-a9f6-4305-9398-3885d256003c service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:52.850663 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-5a53a5b4-87b9-4f97-896e-292ca71f7e13 req-b55c4393-a9f6-4305-9398-3885d256003c service nova] Creating event network-changed:4326f4db-e37d-41b3-b103-744b4119c2d0 for instance 78e9def8-e7ca-4c8e-b83f-f43a93eda200 on hv-cinder-84456 Jun 14 18:35:52.856669 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-5a53a5b4-87b9-4f97-896e-292ca71f7e13 req-b55c4393-a9f6-4305-9398-3885d256003c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032763 Jun 14 18:35:52.857649 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 513/997] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:35:53.008857 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-56d5f19e-c121-4d9a-a64d-fbe04a0c7309 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5d400872474e619ec7b97724021e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea5688a5de847c7bb66afa3c46c759a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:35:53.017590 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-56d5f19e-c121-4d9a-a64d-fbe04a0c7309 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] 10.222.0.78 "GET /compute/v2.1/servers/78e9def8-e7ca-4c8e-b83f-f43a93eda200" status: 200 len: 1313 microversion: 2.1 time: 0.271228 Jun 14 18:35:53.027124 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 485/998] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:52 2022] GET /compute/v2.1/servers/78e9def8-e7ca-4c8e-b83f-f43a93eda200 => generated 1313 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:35:54.036717 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-aacdcdff-2e5f-4028-9462-f4c40fc6e3c7 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:54.037908 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-aacdcdff-2e5f-4028-9462-f4c40fc6e3c7 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] [instance: 78e9def8-e7ca-4c8e-b83f-f43a93eda200] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:54.045208 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-aacdcdff-2e5f-4028-9462-f4c40fc6e3c7 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:54.045434 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-aacdcdff-2e5f-4028-9462-f4c40fc6e3c7 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:54.046431 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-aacdcdff-2e5f-4028-9462-f4c40fc6e3c7 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:54.046937 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-aacdcdff-2e5f-4028-9462-f4c40fc6e3c7 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:54.203784 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-aacdcdff-2e5f-4028-9462-f4c40fc6e3c7 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5d400872474e619ec7b97724021e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea5688a5de847c7bb66afa3c46c759a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:35:54.211509 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-aacdcdff-2e5f-4028-9462-f4c40fc6e3c7 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] 10.222.0.78 "GET /compute/v2.1/servers/78e9def8-e7ca-4c8e-b83f-f43a93eda200" status: 200 len: 1313 microversion: 2.1 time: 0.180480 Jun 14 18:35:54.212459 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 514/999] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:54 2022] GET /compute/v2.1/servers/78e9def8-e7ca-4c8e-b83f-f43a93eda200 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:35:55.232084 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-f707b11a-c28b-4ea4-8539-8d52fc94f81d tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:55.232714 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-f707b11a-c28b-4ea4-8539-8d52fc94f81d tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] [instance: 78e9def8-e7ca-4c8e-b83f-f43a93eda200] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:55.239915 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f707b11a-c28b-4ea4-8539-8d52fc94f81d tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:55.240369 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f707b11a-c28b-4ea4-8539-8d52fc94f81d tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:55.250770 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f707b11a-c28b-4ea4-8539-8d52fc94f81d tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:55.251385 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f707b11a-c28b-4ea4-8539-8d52fc94f81d tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:55.390096 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-f707b11a-c28b-4ea4-8539-8d52fc94f81d tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5d400872474e619ec7b97724021e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea5688a5de847c7bb66afa3c46c759a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:35:55.398315 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-f707b11a-c28b-4ea4-8539-8d52fc94f81d tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] 10.222.0.78 "GET /compute/v2.1/servers/78e9def8-e7ca-4c8e-b83f-f43a93eda200" status: 200 len: 1313 microversion: 2.1 time: 0.172204 Jun 14 18:35:55.398893 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 486/1000] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:55 2022] GET /compute/v2.1/servers/78e9def8-e7ca-4c8e-b83f-f43a93eda200 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:35:56.416326 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-743f360b-be43-47df-89ae-d31595e26b3b tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:56.416932 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-743f360b-be43-47df-89ae-d31595e26b3b tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] [instance: 78e9def8-e7ca-4c8e-b83f-f43a93eda200] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:56.423607 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-743f360b-be43-47df-89ae-d31595e26b3b tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:56.424050 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-743f360b-be43-47df-89ae-d31595e26b3b tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:56.424811 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-743f360b-be43-47df-89ae-d31595e26b3b tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:56.425237 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-743f360b-be43-47df-89ae-d31595e26b3b tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:56.444621 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:35:56.557137 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-743f360b-be43-47df-89ae-d31595e26b3b tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5d400872474e619ec7b97724021e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea5688a5de847c7bb66afa3c46c759a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:35:56.564724 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-743f360b-be43-47df-89ae-d31595e26b3b tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] 10.222.0.78 "GET /compute/v2.1/servers/78e9def8-e7ca-4c8e-b83f-f43a93eda200" status: 200 len: 1313 microversion: 2.1 time: 0.152477 Jun 14 18:35:56.565292 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 515/1001] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:56 2022] GET /compute/v2.1/servers/78e9def8-e7ca-4c8e-b83f-f43a93eda200 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:35:56.977105 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-203b8673-2fb6-4c78-860e-ce253d38fdad tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1477376954", "imageRef": "e2555120-8576-4128-944f-40805aa95a9b", "flavorRef": "452", "networks": [{"uuid": "b92bd074-bf0b-4285-9cfe-d2dccb2d2e20"}]}} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:35:57.037949 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.network.neutron [None req-203b8673-2fb6-4c78-860e-ce253d38fdad tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] validate_networks() for [('b92bd074-bf0b-4285-9cfe-d2dccb2d2e20', None, None, None, None, None)] {{(pid=118623) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 18:35:57.427792 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-203b8673-2fb6-4c78-860e-ce253d38fdad tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Flavor limits 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 18:35:57.428235 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-203b8673-2fb6-4c78-860e-ce253d38fdad tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Image limits 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 18:35:57.428697 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-203b8673-2fb6-4c78-860e-ce253d38fdad tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Flavor pref 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 18:35:57.429108 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-203b8673-2fb6-4c78-860e-ce253d38fdad tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Image pref 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 18:35:57.429560 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-203b8673-2fb6-4c78-860e-ce253d38fdad tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 18:35:57.439108 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-203b8673-2fb6-4c78-860e-ce253d38fdad tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:57.439557 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-203b8673-2fb6-4c78-860e-ce253d38fdad tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:57.440348 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-203b8673-2fb6-4c78-860e-ce253d38fdad tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:57.440789 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-203b8673-2fb6-4c78-860e-ce253d38fdad tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:57.459418 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.quota [None req-203b8673-2fb6-4c78-860e-ce253d38fdad tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Getting quotas for project 64f290418a3e42ba962a70a5af666a9d. Resources: {'instances', 'cores', 'ram'} {{(pid=118623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:35:57.463581 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.quota [None req-203b8673-2fb6-4c78-860e-ce253d38fdad tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Getting quotas for user f183ac34806e46bca89a6c99a8cb62d4 and project 64f290418a3e42ba962a70a5af666a9d. Resources: {'instances', 'cores', 'ram'} {{(pid=118623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:35:57.476011 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-203b8673-2fb6-4c78-860e-ce253d38fdad tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Going to run 1 instances... {{(pid=118623) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 18:35:57.478350 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-203b8673-2fb6-4c78-860e-ce253d38fdad tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 5010e30a-74b2-48c7-9200-8bcd689ae716] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e2555120-8576-4128-944f-40805aa95a9b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118623) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 18:35:57.583308 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-203b8673-2fb6-4c78-860e-ce253d38fdad tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.609983 Jun 14 18:35:57.584224 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-49e4bfff-9b47-469d-81fa-78b478d183d2 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:57.585490 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-49e4bfff-9b47-469d-81fa-78b478d183d2 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] [instance: 78e9def8-e7ca-4c8e-b83f-f43a93eda200] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:57.585965 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 487/1002] 10.222.0.78 () {60 vars in 1146 bytes} [Tue Jun 14 18:35:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 18:35:57.593278 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-49e4bfff-9b47-469d-81fa-78b478d183d2 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:57.593885 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-49e4bfff-9b47-469d-81fa-78b478d183d2 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:57.594747 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-49e4bfff-9b47-469d-81fa-78b478d183d2 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:57.594870 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-365d7e22-27f4-489b-a8ad-69650a0a60ef tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:57.595395 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-365d7e22-27f4-489b-a8ad-69650a0a60ef tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 5010e30a-74b2-48c7-9200-8bcd689ae716] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:57.595511 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-49e4bfff-9b47-469d-81fa-78b478d183d2 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:57.678166 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-365d7e22-27f4-489b-a8ad-69650a0a60ef tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f183ac34806e46bca89a6c99a8cb62d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f290418a3e42ba962a70a5af666a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:35:57.692420 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-365d7e22-27f4-489b-a8ad-69650a0a60ef tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] 10.222.0.78 "GET /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716" status: 200 len: 1219 microversion: 2.1 time: 0.102040 Jun 14 18:35:57.693585 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 488/1003] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:57 2022] GET /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716 => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:35:57.754999 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-49e4bfff-9b47-469d-81fa-78b478d183d2 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5d400872474e619ec7b97724021e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea5688a5de847c7bb66afa3c46c759a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:35:57.763693 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-49e4bfff-9b47-469d-81fa-78b478d183d2 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] 10.222.0.78 "GET /compute/v2.1/servers/78e9def8-e7ca-4c8e-b83f-f43a93eda200" status: 200 len: 1313 microversion: 2.1 time: 0.184492 Jun 14 18:35:57.763693 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 516/1004] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:57 2022] GET /compute/v2.1/servers/78e9def8-e7ca-4c8e-b83f-f43a93eda200 => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:35:58.710238 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-f43c3692-bf90-491e-b4cf-a5c4762eb6f3 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:58.710833 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-f43c3692-bf90-491e-b4cf-a5c4762eb6f3 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 5010e30a-74b2-48c7-9200-8bcd689ae716] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:58.765534 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-f43c3692-bf90-491e-b4cf-a5c4762eb6f3 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f183ac34806e46bca89a6c99a8cb62d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f290418a3e42ba962a70a5af666a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:35:58.772957 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-f43c3692-bf90-491e-b4cf-a5c4762eb6f3 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] 10.222.0.78 "GET /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716" status: 200 len: 1219 microversion: 2.1 time: 0.066635 Jun 14 18:35:58.773927 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 489/1005] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:58 2022] GET /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:35:58.780182 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-805acb69-4f41-4345-9a40-8713796685c2 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:58.781382 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-805acb69-4f41-4345-9a40-8713796685c2 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] [instance: 78e9def8-e7ca-4c8e-b83f-f43a93eda200] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:58.786611 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell0:SELECT=2 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:35:58.787277 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell0:SELECT=6 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:35:58.789738 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-805acb69-4f41-4345-9a40-8713796685c2 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:58.790249 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-805acb69-4f41-4345-9a40-8713796685c2 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:58.791240 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-805acb69-4f41-4345-9a40-8713796685c2 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:58.791684 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-805acb69-4f41-4345-9a40-8713796685c2 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:58.842678 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-ea8fa8d3-f1a6-4b35-88cc-bbc0f61d1840 req-60cebac8-ab9c-451f-b19a-91a80ef144c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78e9def8-e7ca-4c8e-b83f-f43a93eda200", "name": "network-vif-plugged", "status": "completed", "tag": "4326f4db-e37d-41b3-b103-744b4119c2d0"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:35:58.852286 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-ea8fa8d3-f1a6-4b35-88cc-bbc0f61d1840 req-60cebac8-ab9c-451f-b19a-91a80ef144c4 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:58.866346 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-ea8fa8d3-f1a6-4b35-88cc-bbc0f61d1840 req-60cebac8-ab9c-451f-b19a-91a80ef144c4 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:58.866346 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-ea8fa8d3-f1a6-4b35-88cc-bbc0f61d1840 req-60cebac8-ab9c-451f-b19a-91a80ef144c4 service nova] Creating event network-vif-plugged:4326f4db-e37d-41b3-b103-744b4119c2d0 for instance 78e9def8-e7ca-4c8e-b83f-f43a93eda200 on hv-cinder-84456 Jun 14 18:35:58.869007 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-ea8fa8d3-f1a6-4b35-88cc-bbc0f61d1840 req-60cebac8-ab9c-451f-b19a-91a80ef144c4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030110 Jun 14 18:35:58.869637 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 490/1006] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:35:58.970384 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-805acb69-4f41-4345-9a40-8713796685c2 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5d400872474e619ec7b97724021e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea5688a5de847c7bb66afa3c46c759a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:35:58.978458 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-805acb69-4f41-4345-9a40-8713796685c2 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] 10.222.0.78 "GET /compute/v2.1/servers/78e9def8-e7ca-4c8e-b83f-f43a93eda200" status: 200 len: 1313 microversion: 2.1 time: 0.202305 Jun 14 18:35:58.979034 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 517/1007] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:58 2022] GET /compute/v2.1/servers/78e9def8-e7ca-4c8e-b83f-f43a93eda200 => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:35:59.793325 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-26e41732-d50b-43c6-ae12-9cfa3d37a6ed tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:59.796443 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-26e41732-d50b-43c6-ae12-9cfa3d37a6ed tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 5010e30a-74b2-48c7-9200-8bcd689ae716] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:35:59.800507 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-26e41732-d50b-43c6-ae12-9cfa3d37a6ed tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:59.800952 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-26e41732-d50b-43c6-ae12-9cfa3d37a6ed tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:59.802033 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-26e41732-d50b-43c6-ae12-9cfa3d37a6ed tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:35:59.802585 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-26e41732-d50b-43c6-ae12-9cfa3d37a6ed tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:35:59.874794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-26e41732-d50b-43c6-ae12-9cfa3d37a6ed tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f183ac34806e46bca89a6c99a8cb62d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f290418a3e42ba962a70a5af666a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:35:59.882737 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-26e41732-d50b-43c6-ae12-9cfa3d37a6ed tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] 10.222.0.78 "GET /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716" status: 200 len: 1271 microversion: 2.1 time: 0.095040 Jun 14 18:35:59.883523 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 491/1008] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:59 2022] GET /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716 => generated 1271 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:35:59.995988 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-5dc1accd-b5e9-4171-bf13-8a8a311c0121 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:35:59.996691 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-5dc1accd-b5e9-4171-bf13-8a8a311c0121 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] [instance: 78e9def8-e7ca-4c8e-b83f-f43a93eda200] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:36:00.005215 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5dc1accd-b5e9-4171-bf13-8a8a311c0121 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:00.005215 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5dc1accd-b5e9-4171-bf13-8a8a311c0121 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:00.009178 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5dc1accd-b5e9-4171-bf13-8a8a311c0121 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:00.010780 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5dc1accd-b5e9-4171-bf13-8a8a311c0121 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:00.155816 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-5dc1accd-b5e9-4171-bf13-8a8a311c0121 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5d400872474e619ec7b97724021e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea5688a5de847c7bb66afa3c46c759a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:36:00.163998 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-5dc1accd-b5e9-4171-bf13-8a8a311c0121 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] 10.222.0.78 "GET /compute/v2.1/servers/78e9def8-e7ca-4c8e-b83f-f43a93eda200" status: 200 len: 1313 microversion: 2.1 time: 0.172124 Jun 14 18:36:00.164649 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 518/1009] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:35:59 2022] GET /compute/v2.1/servers/78e9def8-e7ca-4c8e-b83f-f43a93eda200 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:36:00.900894 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-e440e3da-8df9-4d8c-ac87-7021774cd1e1 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:36:00.901518 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-e440e3da-8df9-4d8c-ac87-7021774cd1e1 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 5010e30a-74b2-48c7-9200-8bcd689ae716] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:36:00.908180 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e440e3da-8df9-4d8c-ac87-7021774cd1e1 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:00.908661 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e440e3da-8df9-4d8c-ac87-7021774cd1e1 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:00.909420 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e440e3da-8df9-4d8c-ac87-7021774cd1e1 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:00.910142 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e440e3da-8df9-4d8c-ac87-7021774cd1e1 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:00.993431 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-e440e3da-8df9-4d8c-ac87-7021774cd1e1 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f183ac34806e46bca89a6c99a8cb62d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f290418a3e42ba962a70a5af666a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:36:01.001999 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-e440e3da-8df9-4d8c-ac87-7021774cd1e1 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] 10.222.0.78 "GET /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716" status: 200 len: 1279 microversion: 2.1 time: 0.105215 Jun 14 18:36:01.002762 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 492/1010] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:36:00 2022] GET /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716 => generated 1279 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:36:01.191925 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-9dd1f830-2940-4343-b6de-0fb5dc439239 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:36:01.194023 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-9dd1f830-2940-4343-b6de-0fb5dc439239 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] [instance: 78e9def8-e7ca-4c8e-b83f-f43a93eda200] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:36:01.201853 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9dd1f830-2940-4343-b6de-0fb5dc439239 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:01.202584 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9dd1f830-2940-4343-b6de-0fb5dc439239 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:01.203439 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9dd1f830-2940-4343-b6de-0fb5dc439239 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:01.204473 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9dd1f830-2940-4343-b6de-0fb5dc439239 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:01.365545 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-9dd1f830-2940-4343-b6de-0fb5dc439239 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5d400872474e619ec7b97724021e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea5688a5de847c7bb66afa3c46c759a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:36:01.373634 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-9dd1f830-2940-4343-b6de-0fb5dc439239 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] 10.222.0.78 "GET /compute/v2.1/servers/78e9def8-e7ca-4c8e-b83f-f43a93eda200" status: 200 len: 1496 microversion: 2.1 time: 0.197152 Jun 14 18:36:01.374209 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 519/1011] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:36:01 2022] GET /compute/v2.1/servers/78e9def8-e7ca-4c8e-b83f-f43a93eda200 => generated 1496 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:36:02.018907 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-b48ec6fa-d17f-40b1-a64d-a178dfd2795f tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:36:02.019521 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-b48ec6fa-d17f-40b1-a64d-a178dfd2795f tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 5010e30a-74b2-48c7-9200-8bcd689ae716] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:36:02.026163 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b48ec6fa-d17f-40b1-a64d-a178dfd2795f tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:02.026617 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b48ec6fa-d17f-40b1-a64d-a178dfd2795f tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:02.027956 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b48ec6fa-d17f-40b1-a64d-a178dfd2795f tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:02.028414 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b48ec6fa-d17f-40b1-a64d-a178dfd2795f tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:02.212558 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-b48ec6fa-d17f-40b1-a64d-a178dfd2795f tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f183ac34806e46bca89a6c99a8cb62d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f290418a3e42ba962a70a5af666a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:36:02.221390 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-b48ec6fa-d17f-40b1-a64d-a178dfd2795f tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] 10.222.0.78 "GET /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716" status: 200 len: 1319 microversion: 2.1 time: 0.206504 Jun 14 18:36:02.231355 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 493/1012] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:36:02 2022] GET /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716 => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:36:02.231607 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-8aad3ce7-a3cd-42b6-890a-05aaa7af60f4 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:36:02.231607 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-8aad3ce7-a3cd-42b6-890a-05aaa7af60f4 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] [instance: 78e9def8-e7ca-4c8e-b83f-f43a93eda200] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:36:02.239237 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8aad3ce7-a3cd-42b6-890a-05aaa7af60f4 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:02.239237 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8aad3ce7-a3cd-42b6-890a-05aaa7af60f4 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:02.239516 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8aad3ce7-a3cd-42b6-890a-05aaa7af60f4 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:02.239825 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-8aad3ce7-a3cd-42b6-890a-05aaa7af60f4 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:02.272009 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-8aad3ce7-a3cd-42b6-890a-05aaa7af60f4 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] [instance: 78e9def8-e7ca-4c8e-b83f-f43a93eda200] Going to try to terminate instance {{(pid=118624) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:36:02.513501 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-e5a43174-48a4-4a55-adcc-c6f4c5fb3020 req-3c2bd87a-bc3a-4388-8c64-14018673c1a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5010e30a-74b2-48c7-9200-8bcd689ae716", "tag": "c4e3043d-10d0-4d1c-922a-cab5ae2a715a"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:36:02.521937 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-e5a43174-48a4-4a55-adcc-c6f4c5fb3020 req-3c2bd87a-bc3a-4388-8c64-14018673c1a4 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:02.522379 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-e5a43174-48a4-4a55-adcc-c6f4c5fb3020 req-3c2bd87a-bc3a-4388-8c64-14018673c1a4 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:02.533766 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-e5a43174-48a4-4a55-adcc-c6f4c5fb3020 req-3c2bd87a-bc3a-4388-8c64-14018673c1a4 service nova] Creating event network-changed:c4e3043d-10d0-4d1c-922a-cab5ae2a715a for instance 5010e30a-74b2-48c7-9200-8bcd689ae716 on hv-cinder-84456 Jun 14 18:36:02.538744 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-e5a43174-48a4-4a55-adcc-c6f4c5fb3020 req-3c2bd87a-bc3a-4388-8c64-14018673c1a4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029238 Jun 14 18:36:02.539331 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 494/1013] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:36:02.588157 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-8aad3ce7-a3cd-42b6-890a-05aaa7af60f4 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] 10.222.0.78 "DELETE /compute/v2.1/servers/78e9def8-e7ca-4c8e-b83f-f43a93eda200" status: 204 len: 0 microversion: 2.1 time: 0.361700 Jun 14 18:36:02.588956 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 520/1014] 10.222.0.78 () {58 vars in 1238 bytes} [Tue Jun 14 18:36:02 2022] DELETE /compute/v2.1/servers/78e9def8-e7ca-4c8e-b83f-f43a93eda200 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 14 18:36:02.598137 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-bb60cf85-d0db-4905-938e-662a80a0cf35 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:36:02.598853 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-bb60cf85-d0db-4905-938e-662a80a0cf35 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] [instance: 78e9def8-e7ca-4c8e-b83f-f43a93eda200] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:36:02.606933 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-bb60cf85-d0db-4905-938e-662a80a0cf35 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:02.607848 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-bb60cf85-d0db-4905-938e-662a80a0cf35 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:02.609042 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-bb60cf85-d0db-4905-938e-662a80a0cf35 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:02.609515 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-bb60cf85-d0db-4905-938e-662a80a0cf35 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:02.771938 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-bb60cf85-d0db-4905-938e-662a80a0cf35 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5d400872474e619ec7b97724021e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea5688a5de847c7bb66afa3c46c759a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:36:02.780714 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-bb60cf85-d0db-4905-938e-662a80a0cf35 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] 10.222.0.78 "GET /compute/v2.1/servers/78e9def8-e7ca-4c8e-b83f-f43a93eda200" status: 200 len: 1502 microversion: 2.1 time: 0.186845 Jun 14 18:36:02.781287 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 495/1015] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:36:02 2022] GET /compute/v2.1/servers/78e9def8-e7ca-4c8e-b83f-f43a93eda200 => generated 1502 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:36:03.239524 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-6fbee519-80bb-4922-96ac-f464219a4241 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:36:03.240222 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-6fbee519-80bb-4922-96ac-f464219a4241 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 5010e30a-74b2-48c7-9200-8bcd689ae716] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:36:03.247858 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6fbee519-80bb-4922-96ac-f464219a4241 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:03.252567 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6fbee519-80bb-4922-96ac-f464219a4241 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:03.252567 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6fbee519-80bb-4922-96ac-f464219a4241 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:03.252567 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6fbee519-80bb-4922-96ac-f464219a4241 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:03.497463 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-6fbee519-80bb-4922-96ac-f464219a4241 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f183ac34806e46bca89a6c99a8cb62d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f290418a3e42ba962a70a5af666a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:36:03.507264 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-6fbee519-80bb-4922-96ac-f464219a4241 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] 10.222.0.78 "GET /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716" status: 200 len: 1319 microversion: 2.1 time: 0.271914 Jun 14 18:36:03.507847 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 521/1016] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:36:03 2022] GET /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716 => generated 1319 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:36:03.801770 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-384f65fb-db38-40db-9752-a5f462493f55 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:36:03.803483 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-384f65fb-db38-40db-9752-a5f462493f55 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] [instance: 78e9def8-e7ca-4c8e-b83f-f43a93eda200] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:36:03.814630 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-384f65fb-db38-40db-9752-a5f462493f55 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:03.815257 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-384f65fb-db38-40db-9752-a5f462493f55 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:03.816458 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-384f65fb-db38-40db-9752-a5f462493f55 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:03.817469 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-384f65fb-db38-40db-9752-a5f462493f55 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:04.082455 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-384f65fb-db38-40db-9752-a5f462493f55 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5d400872474e619ec7b97724021e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea5688a5de847c7bb66afa3c46c759a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:36:04.090780 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-384f65fb-db38-40db-9752-a5f462493f55 tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] 10.222.0.78 "GET /compute/v2.1/servers/78e9def8-e7ca-4c8e-b83f-f43a93eda200" status: 200 len: 1502 microversion: 2.1 time: 0.295211 Jun 14 18:36:04.095447 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 496/1017] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:36:03 2022] GET /compute/v2.1/servers/78e9def8-e7ca-4c8e-b83f-f43a93eda200 => generated 1502 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:36:04.524712 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-292e8902-f7e2-47c1-8790-9497c4de346d tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:36:04.525623 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-292e8902-f7e2-47c1-8790-9497c4de346d tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 5010e30a-74b2-48c7-9200-8bcd689ae716] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:36:04.533817 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-292e8902-f7e2-47c1-8790-9497c4de346d tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:04.534950 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-292e8902-f7e2-47c1-8790-9497c4de346d tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:04.535938 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-292e8902-f7e2-47c1-8790-9497c4de346d tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:04.536539 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-292e8902-f7e2-47c1-8790-9497c4de346d tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:04.994244 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-a813569e-c573-41ff-b0d0-e0290fd2425c req-4dbbc842-95d7-4aa4-844c-3d224661fb85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78e9def8-e7ca-4c8e-b83f-f43a93eda200", "name": "network-vif-deleted", "tag": "4326f4db-e37d-41b3-b103-744b4119c2d0"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:36:05.003100 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-a813569e-c573-41ff-b0d0-e0290fd2425c req-4dbbc842-95d7-4aa4-844c-3d224661fb85 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:05.004183 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-a813569e-c573-41ff-b0d0-e0290fd2425c req-4dbbc842-95d7-4aa4-844c-3d224661fb85 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:05.015666 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-a813569e-c573-41ff-b0d0-e0290fd2425c req-4dbbc842-95d7-4aa4-844c-3d224661fb85 service nova] Creating event network-vif-deleted:4326f4db-e37d-41b3-b103-744b4119c2d0 for instance 78e9def8-e7ca-4c8e-b83f-f43a93eda200 on hv-cinder-84456 Jun 14 18:36:05.020656 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-a813569e-c573-41ff-b0d0-e0290fd2425c req-4dbbc842-95d7-4aa4-844c-3d224661fb85 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030588 Jun 14 18:36:05.021355 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 497/1018] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:36:05.095719 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-292e8902-f7e2-47c1-8790-9497c4de346d tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f183ac34806e46bca89a6c99a8cb62d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f290418a3e42ba962a70a5af666a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:36:05.103775 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-292e8902-f7e2-47c1-8790-9497c4de346d tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] 10.222.0.78 "GET /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716" status: 200 len: 1319 microversion: 2.1 time: 0.582790 Jun 14 18:36:05.104365 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 522/1019] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:36:04 2022] GET /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716 => generated 1319 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:36:05.113677 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-eb5db68c-edbb-4a7b-8921-5521bb8c8fcc tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:36:05.113677 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-eb5db68c-edbb-4a7b-8921-5521bb8c8fcc tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] [instance: 78e9def8-e7ca-4c8e-b83f-f43a93eda200] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:36:05.118385 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-eb5db68c-edbb-4a7b-8921-5521bb8c8fcc tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:05.122358 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-eb5db68c-edbb-4a7b-8921-5521bb8c8fcc tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:05.122358 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-eb5db68c-edbb-4a7b-8921-5521bb8c8fcc tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:05.122358 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-eb5db68c-edbb-4a7b-8921-5521bb8c8fcc tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:05.206969 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-eb5db68c-edbb-4a7b-8921-5521bb8c8fcc tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e5d400872474e619ec7b97724021e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea5688a5de847c7bb66afa3c46c759a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:36:05.215363 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-eb5db68c-edbb-4a7b-8921-5521bb8c8fcc tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] 10.222.0.78 "GET /compute/v2.1/servers/78e9def8-e7ca-4c8e-b83f-f43a93eda200" status: 200 len: 1460 microversion: 2.1 time: 0.109190 Jun 14 18:36:05.216172 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 498/1020] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:36:05 2022] GET /compute/v2.1/servers/78e9def8-e7ca-4c8e-b83f-f43a93eda200 => generated 1460 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:36:06.123442 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-98c7c61e-6d41-4312-957b-fac3afe3e7ae tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:36:06.124067 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-98c7c61e-6d41-4312-957b-fac3afe3e7ae tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 5010e30a-74b2-48c7-9200-8bcd689ae716] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:36:06.130465 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-98c7c61e-6d41-4312-957b-fac3afe3e7ae tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:06.131185 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-98c7c61e-6d41-4312-957b-fac3afe3e7ae tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:06.132101 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-98c7c61e-6d41-4312-957b-fac3afe3e7ae tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:06.133157 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-98c7c61e-6d41-4312-957b-fac3afe3e7ae tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:06.233466 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-c4f0a004-80a3-4e20-86a1-be1ddb84ae6f tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:36:06.234076 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-c4f0a004-80a3-4e20-86a1-be1ddb84ae6f tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] [instance: 78e9def8-e7ca-4c8e-b83f-f43a93eda200] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:36:06.241481 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c4f0a004-80a3-4e20-86a1-be1ddb84ae6f tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:06.242228 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c4f0a004-80a3-4e20-86a1-be1ddb84ae6f tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:06.243319 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c4f0a004-80a3-4e20-86a1-be1ddb84ae6f tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:06.243688 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c4f0a004-80a3-4e20-86a1-be1ddb84ae6f tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:06.259861 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.wsgi [None req-c4f0a004-80a3-4e20-86a1-be1ddb84ae6f tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] HTTP exception thrown: Instance 78e9def8-e7ca-4c8e-b83f-f43a93eda200 could not be found. Jun 14 18:36:06.262402 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-c4f0a004-80a3-4e20-86a1-be1ddb84ae6f tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Request method failure captured: Jun 14 18:36:06.262402 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: request: GET /compute/v2.1/servers/78e9def8-e7ca-4c8e-b83f-f43a93eda200 HTTP/1.1 Jun 14 18:36:06.262402 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept: application/json Jun 14 18:36:06.262402 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept-Encoding: identity Jun 14 18:36:06.262402 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Connection: close Jun 14 18:36:06.262402 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Length: 0 Jun 14 18:36:06.262402 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Type: application/json Jun 14 18:36:06.262402 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Host: 10.222.0.78 Jun 14 18:36:06.262402 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Openstack-System-Scope: None Jun 14 18:36:06.262402 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: User-Agent: python-urllib3/1.26.9 Jun 14 18:36:06.262402 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Auth-Token: gAAAAABiqNTsgoubIkBghQaMLkiEpjAKNnk29DqXLkUndEYW2dwqupSiHZX2PCTkK-eawW430lGQJQ5huXz6y6yJrxEeQQwt4X2Ff-E_B2lPB7ecpocK2tdpDVvL6epxGaPS4R2NfIpnUujHZqwAkKaj79EQ-MFg4saW4tcGGD7gp6vZpx9_LfM Jun 14 18:36:06.262402 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Id: None Jun 14 18:36:06.262402 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Name: None Jun 14 18:36:06.262402 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Identity-Status: Confirmed Jun 14 18:36:06.262402 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Is-Admin-Project: True Jun 14 18:36:06.262402 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Id: default Jun 14 18:36:06.262402 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Name: Default Jun 14 18:36:06.262402 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Id: eea5688a5de847c7bb66afa3c46c759a Jun 14 18:36:06.262402 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Name: tempest-VolumesActionsTest-272654221 Jun 14 18:36:06.262402 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Role: reader,member Jun 14 18:36:06.262402 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Roles: reader,member Jun 14 18:36:06.264196 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_eea5688a5de847c7bb66afa3c46c759a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/eea5688a5de847c7bb66afa3c46c759a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/eea5688a5de847c7bb66afa3c46c759a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/eea5688a5de847c7bb66afa3c46c759a"}]}] Jun 14 18:36:06.264196 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant: tempest-VolumesActionsTest-272654221 Jun 14 18:36:06.264196 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Id: eea5688a5de847c7bb66afa3c46c759a Jun 14 18:36:06.264196 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Name: tempest-VolumesActionsTest-272654221 Jun 14 18:36:06.264196 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User: tempest-VolumesActionsTest-272654221-project Jun 14 18:36:06.264196 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Id: default Jun 14 18:36:06.264196 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Name: Default Jun 14 18:36:06.264196 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Id: 7e5d400872474e619ec7b97724021e25 Jun 14 18:36:06.264196 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Name: tempest-VolumesActionsTest-272654221-project Jun 14 18:36:06.264196 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: method: > Jun 14 18:36:06.264196 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: exception: Instance 78e9def8-e7ca-4c8e-b83f-f43a93eda200 could not be found. Jun 14 18:36:06.264196 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: action_args: {'id': '78e9def8-e7ca-4c8e-b83f-f43a93eda200'} Jun 14 18:36:06.265188 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:36:06.265188 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:36:06.265188 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:36:06.265188 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:36:06.265188 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:36:06.265188 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:36:06.265188 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:36:06.265188 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:36:06.265188 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:36:06.265188 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:36:06.265188 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78e9def8-e7ca-4c8e-b83f-f43a93eda200 could not be found. Jun 14 18:36:06.265188 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:36:06.265188 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:36:06.265188 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:36:06.265188 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:36:06.265188 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:36:06.265188 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:36:06.265188 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:36:06.265188 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:36:06.265188 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:36:06.266706 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:36:06.266706 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:36:06.266706 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:36:06.266706 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:36:06.266706 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:36:06.266706 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:36:06.266706 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:36:06.266706 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78e9def8-e7ca-4c8e-b83f-f43a93eda200 could not be found. Jun 14 18:36:06.266706 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:36:06.266706 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:36:06.266706 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:36:06.266706 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:36:06.266706 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:36:06.266706 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:36:06.266706 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:36:06.266706 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:36:06.266706 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78e9def8-e7ca-4c8e-b83f-f43a93eda200 could not be found. Jun 14 18:36:06.266706 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:36:06.268238 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-c4f0a004-80a3-4e20-86a1-be1ddb84ae6f tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] Returning 404 to user: Instance 78e9def8-e7ca-4c8e-b83f-f43a93eda200 could not be found. {{(pid=118623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:36:06.268238 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-c4f0a004-80a3-4e20-86a1-be1ddb84ae6f tempest-VolumesActionsTest-272654221 tempest-VolumesActionsTest-272654221-project] 10.222.0.78 "GET /compute/v2.1/servers/78e9def8-e7ca-4c8e-b83f-f43a93eda200" status: 404 len: 111 microversion: 2.1 time: 0.035599 Jun 14 18:36:06.268238 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 499/1021] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:36:06 2022] GET /compute/v2.1/servers/78e9def8-e7ca-4c8e-b83f-f43a93eda200 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 14 18:36:06.318626 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-98c7c61e-6d41-4312-957b-fac3afe3e7ae tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f183ac34806e46bca89a6c99a8cb62d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f290418a3e42ba962a70a5af666a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:36:06.326842 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-98c7c61e-6d41-4312-957b-fac3afe3e7ae tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] 10.222.0.78 "GET /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716" status: 200 len: 1319 microversion: 2.1 time: 0.208200 Jun 14 18:36:06.327401 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 523/1022] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:36:06 2022] GET /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716 => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:36:07.350875 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-e117ca08-4c1e-432e-82e8-3c102c51526e tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:36:07.352328 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-e117ca08-4c1e-432e-82e8-3c102c51526e tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 5010e30a-74b2-48c7-9200-8bcd689ae716] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:36:07.391532 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e117ca08-4c1e-432e-82e8-3c102c51526e tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:07.395275 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e117ca08-4c1e-432e-82e8-3c102c51526e tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:07.396398 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e117ca08-4c1e-432e-82e8-3c102c51526e tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:07.397897 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e117ca08-4c1e-432e-82e8-3c102c51526e tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:07.417337 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell1:SELECT=100 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:36:07.452114 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell0:SELECT=2 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:36:07.649572 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-e117ca08-4c1e-432e-82e8-3c102c51526e tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f183ac34806e46bca89a6c99a8cb62d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f290418a3e42ba962a70a5af666a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:36:07.660681 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-e117ca08-4c1e-432e-82e8-3c102c51526e tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] 10.222.0.78 "GET /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716" status: 200 len: 1319 microversion: 2.1 time: 0.320379 Jun 14 18:36:07.671623 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 500/1023] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:36:07 2022] GET /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716 => generated 1319 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:36:08.679012 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-0a14538a-cb1e-4b47-9428-ad53d89a673a tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:36:08.679625 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-0a14538a-cb1e-4b47-9428-ad53d89a673a tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 5010e30a-74b2-48c7-9200-8bcd689ae716] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:36:08.687362 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-0a14538a-cb1e-4b47-9428-ad53d89a673a tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:08.687718 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-0a14538a-cb1e-4b47-9428-ad53d89a673a tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:08.688632 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-0a14538a-cb1e-4b47-9428-ad53d89a673a tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:08.689078 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-0a14538a-cb1e-4b47-9428-ad53d89a673a tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:08.847549 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-0a14538a-cb1e-4b47-9428-ad53d89a673a tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f183ac34806e46bca89a6c99a8cb62d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f290418a3e42ba962a70a5af666a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:36:08.855706 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-0a14538a-cb1e-4b47-9428-ad53d89a673a tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] 10.222.0.78 "GET /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716" status: 200 len: 1319 microversion: 2.1 time: 0.180929 Jun 14 18:36:08.856285 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 524/1024] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:36:08 2022] GET /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:36:09.142873 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-b763adf0-1ce0-4482-b6b4-07aa70b1522d req-a2795b29-804d-4aaf-bf74-9048f3f7bcaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5010e30a-74b2-48c7-9200-8bcd689ae716", "name": "network-vif-plugged", "status": "completed", "tag": "c4e3043d-10d0-4d1c-922a-cab5ae2a715a"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:36:09.148469 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell0:SELECT=12 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:36:09.155617 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-b763adf0-1ce0-4482-b6b4-07aa70b1522d req-a2795b29-804d-4aaf-bf74-9048f3f7bcaf service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:09.155617 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-b763adf0-1ce0-4482-b6b4-07aa70b1522d req-a2795b29-804d-4aaf-bf74-9048f3f7bcaf service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:09.168750 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-b763adf0-1ce0-4482-b6b4-07aa70b1522d req-a2795b29-804d-4aaf-bf74-9048f3f7bcaf service nova] Creating event network-vif-plugged:c4e3043d-10d0-4d1c-922a-cab5ae2a715a for instance 5010e30a-74b2-48c7-9200-8bcd689ae716 on hv-cinder-84456 Jun 14 18:36:09.186455 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-b763adf0-1ce0-4482-b6b4-07aa70b1522d req-a2795b29-804d-4aaf-bf74-9048f3f7bcaf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036587 Jun 14 18:36:09.186455 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 501/1025] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:36:09.877270 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-c0c43df3-eee3-4f20-8ba3-afc8fd3abd67 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:36:09.877270 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-c0c43df3-eee3-4f20-8ba3-afc8fd3abd67 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 5010e30a-74b2-48c7-9200-8bcd689ae716] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:36:09.886951 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c0c43df3-eee3-4f20-8ba3-afc8fd3abd67 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:09.887369 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c0c43df3-eee3-4f20-8ba3-afc8fd3abd67 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:09.888034 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c0c43df3-eee3-4f20-8ba3-afc8fd3abd67 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:09.888480 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c0c43df3-eee3-4f20-8ba3-afc8fd3abd67 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:10.086714 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-c0c43df3-eee3-4f20-8ba3-afc8fd3abd67 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f183ac34806e46bca89a6c99a8cb62d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f290418a3e42ba962a70a5af666a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:36:10.095531 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-c0c43df3-eee3-4f20-8ba3-afc8fd3abd67 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] 10.222.0.78 "GET /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716" status: 200 len: 1319 microversion: 2.1 time: 0.226947 Jun 14 18:36:10.096727 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 525/1026] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:36:09 2022] GET /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716 => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:36:11.114907 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-d176af03-d325-4137-acad-889a8c4993c4 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:36:11.118309 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-d176af03-d325-4137-acad-889a8c4993c4 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 5010e30a-74b2-48c7-9200-8bcd689ae716] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:36:11.127655 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:36:11.153051 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d176af03-d325-4137-acad-889a8c4993c4 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:11.153884 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d176af03-d325-4137-acad-889a8c4993c4 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:11.155506 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d176af03-d325-4137-acad-889a8c4993c4 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:11.156518 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d176af03-d325-4137-acad-889a8c4993c4 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:11.454526 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-d176af03-d325-4137-acad-889a8c4993c4 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f183ac34806e46bca89a6c99a8cb62d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f290418a3e42ba962a70a5af666a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:36:11.465890 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-d176af03-d325-4137-acad-889a8c4993c4 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] 10.222.0.78 "GET /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716" status: 200 len: 1319 microversion: 2.1 time: 0.356311 Jun 14 18:36:11.468525 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 502/1027] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:36:11 2022] GET /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716 => generated 1319 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:36:12.490586 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-cc868861-feef-4750-a2bf-cb05ac802a12 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:36:12.491785 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-cc868861-feef-4750-a2bf-cb05ac802a12 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 5010e30a-74b2-48c7-9200-8bcd689ae716] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:36:12.505628 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:36:12.508514 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-cc868861-feef-4750-a2bf-cb05ac802a12 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:12.509291 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-cc868861-feef-4750-a2bf-cb05ac802a12 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:12.510896 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-cc868861-feef-4750-a2bf-cb05ac802a12 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:12.511637 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-cc868861-feef-4750-a2bf-cb05ac802a12 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:13.061003 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-cc868861-feef-4750-a2bf-cb05ac802a12 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f183ac34806e46bca89a6c99a8cb62d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f290418a3e42ba962a70a5af666a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:36:13.073721 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-cc868861-feef-4750-a2bf-cb05ac802a12 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] 10.222.0.78 "GET /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716" status: 200 len: 1319 microversion: 2.1 time: 0.586270 Jun 14 18:36:13.084180 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 526/1028] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:36:12 2022] GET /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716 => generated 1319 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:36:14.093475 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-b060d0e5-ad13-4dea-b5ef-6630a2a7fd72 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:36:14.094027 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-b060d0e5-ad13-4dea-b5ef-6630a2a7fd72 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 5010e30a-74b2-48c7-9200-8bcd689ae716] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:36:14.101011 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b060d0e5-ad13-4dea-b5ef-6630a2a7fd72 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:14.102307 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b060d0e5-ad13-4dea-b5ef-6630a2a7fd72 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:14.105136 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b060d0e5-ad13-4dea-b5ef-6630a2a7fd72 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:14.105136 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b060d0e5-ad13-4dea-b5ef-6630a2a7fd72 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:14.335809 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-b060d0e5-ad13-4dea-b5ef-6630a2a7fd72 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f183ac34806e46bca89a6c99a8cb62d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f290418a3e42ba962a70a5af666a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:36:14.349970 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-b060d0e5-ad13-4dea-b5ef-6630a2a7fd72 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] 10.222.0.78 "GET /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716" status: 200 len: 1509 microversion: 2.1 time: 0.261584 Jun 14 18:36:14.366366 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 503/1029] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:36:14 2022] GET /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716 => generated 1509 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:36:16.658174 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-0442340c-ae03-4022-863b-2e7228aefdea tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Action: 'create', calling method: .version_select at 0x7efe70188820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1923373548", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3HbD/FzR8uWg8ZTdpmKI9vFcMb45ggQjo/BS8gMVuglZ3NvWck06JsZfypd2jiPrqCAwA74mAmNcnUc4GchfIaHpmh7HKygiZHlqdutHPBmKyEBnt5HGqz1dQ6kM6amw=="}} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:36:16.673682 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.quota [None req-0442340c-ae03-4022-863b-2e7228aefdea tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Getting quotas for project 4c8c7a8868b741feb66d6a3b8c761d9e. Resources: {'key_pairs'} {{(pid=118624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:36:16.677561 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.quota [None req-0442340c-ae03-4022-863b-2e7228aefdea tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Getting quotas for user f9df6279bdd140448c4f7717942f2beb and project 4c8c7a8868b741feb66d6a3b8c761d9e. Resources: {'key_pairs'} {{(pid=118624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:36:16.755527 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-0442340c-ae03-4022-863b-2e7228aefdea tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.292218 Jun 14 18:36:16.756242 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 527/1030] 10.222.0.78 () {60 vars in 1158 bytes} [Tue Jun 14 18:36:16 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:36:30.238224 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 18:36:30.239395 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Tue Jun 14 18:36:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 14 18:36:35.600196 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-1c4bce00-9cb0-4776-9469-e61d80425420 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb897aa8-7892-4640-8ae0-d51e8234e06d", "device": "/dev/sdb"}} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:36:35.601925 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-1c4bce00-9cb0-4776-9469-e61d80425420 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 5010e30a-74b2-48c7-9200-8bcd689ae716] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:36:35.606017 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_api:SELECT=3 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:36:35.606258 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell1:SELECT=19 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:36:35.616627 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1c4bce00-9cb0-4776-9469-e61d80425420 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:35.617162 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1c4bce00-9cb0-4776-9469-e61d80425420 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:35.618058 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1c4bce00-9cb0-4776-9469-e61d80425420 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:35.618488 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1c4bce00-9cb0-4776-9469-e61d80425420 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:36.299728 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-1c4bce00-9cb0-4776-9469-e61d80425420 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] 10.222.0.78 "POST /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.703633 Jun 14 18:36:36.301511 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 504/1031] 10.222.0.78 () {60 vars in 1322 bytes} [Tue Jun 14 18:36:35 2022] POST /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716/os-volume_attachments => generated 194 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:36:54.487819 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-a2639017-9287-431b-a34b-24a25664df49 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-183867699", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1923373548", "security_groups": [{"name": "tempest-secgroup-smoke-1112180450"}], "block_device_mapping_v2": [{"uuid": "0d2d0611-6576-44b1-97c3-1bf8cad00ece", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5e1d771e-6723-48d3-994d-42a6b0e70992"}]}} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:36:54.496572 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:36:54.497227 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell0:SELECT=4 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:36:54.497849 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_api:SELECT=12,nova_api:INSERT=1 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:36:54.602521 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.network.neutron [None req-a2639017-9287-431b-a34b-24a25664df49 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] validate_networks() for [('5e1d771e-6723-48d3-994d-42a6b0e70992', None, None, None, None, None)] {{(pid=118624) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 18:36:54.973855 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-a2639017-9287-431b-a34b-24a25664df49 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Flavor limits 0:0:0 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 18:36:54.974282 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-a2639017-9287-431b-a34b-24a25664df49 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Image limits 0:0:0 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 18:36:54.974749 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-a2639017-9287-431b-a34b-24a25664df49 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Flavor pref 0:0:0 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 18:36:54.975185 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-a2639017-9287-431b-a34b-24a25664df49 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Image pref 0:0:0 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 18:36:54.975595 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-a2639017-9287-431b-a34b-24a25664df49 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 18:36:54.985179 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a2639017-9287-431b-a34b-24a25664df49 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:54.985684 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a2639017-9287-431b-a34b-24a25664df49 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:54.986465 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a2639017-9287-431b-a34b-24a25664df49 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:54.986905 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a2639017-9287-431b-a34b-24a25664df49 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:55.003281 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.quota [None req-a2639017-9287-431b-a34b-24a25664df49 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Getting quotas for project 4c8c7a8868b741feb66d6a3b8c761d9e. Resources: {'instances', 'cores', 'ram'} {{(pid=118624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:36:55.007215 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.quota [None req-a2639017-9287-431b-a34b-24a25664df49 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Getting quotas for user f9df6279bdd140448c4f7717942f2beb and project 4c8c7a8868b741feb66d6a3b8c761d9e. Resources: {'instances', 'cores', 'ram'} {{(pid=118624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:36:55.064159 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-a2639017-9287-431b-a34b-24a25664df49 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Going to run 1 instances... {{(pid=118624) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 18:36:55.066282 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-a2639017-9287-431b-a34b-24a25664df49 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: c004d7e4-71d3-418b-95f2-736cef250bdc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0d2d0611-6576-44b1-97c3-1bf8cad00ece',volume_size=None,volume_type=None)] {{(pid=118624) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 18:36:55.490159 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-a2639017-9287-431b-a34b-24a25664df49 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.006112 Jun 14 18:36:55.490818 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 528/1032] 10.222.0.78 () {60 vars in 1146 bytes} [Tue Jun 14 18:36:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 1008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 18:36:55.498964 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_api:SELECT=2 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:36:55.499961 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:36:55.504154 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-ddf149fe-c36c-47a2-ab1e-9f318a5e9ac1 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:36:55.504890 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-ddf149fe-c36c-47a2-ab1e-9f318a5e9ac1 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: c004d7e4-71d3-418b-95f2-736cef250bdc] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:36:55.561931 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-ddf149fe-c36c-47a2-ab1e-9f318a5e9ac1 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:36:55.569650 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-ddf149fe-c36c-47a2-ab1e-9f318a5e9ac1 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc" status: 200 len: 1094 microversion: 2.1 time: 0.072396 Jun 14 18:36:55.570304 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 505/1033] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:36:55 2022] GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:36:56.588377 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-2770b7e1-882d-42fe-a9e3-742903ce8978 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:36:56.588949 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-2770b7e1-882d-42fe-a9e3-742903ce8978 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: c004d7e4-71d3-418b-95f2-736cef250bdc] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:36:56.596414 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2770b7e1-882d-42fe-a9e3-742903ce8978 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:56.596863 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2770b7e1-882d-42fe-a9e3-742903ce8978 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:56.597683 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2770b7e1-882d-42fe-a9e3-742903ce8978 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:56.598109 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2770b7e1-882d-42fe-a9e3-742903ce8978 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:56.659943 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-2770b7e1-882d-42fe-a9e3-742903ce8978 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:36:56.667806 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-2770b7e1-882d-42fe-a9e3-742903ce8978 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc" status: 200 len: 1144 microversion: 2.1 time: 0.083891 Jun 14 18:36:56.668385 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 529/1034] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:36:56 2022] GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc => generated 1144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:36:57.686290 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-06c625c0-23f0-4cba-a3fe-e9b4b6a5399c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:36:57.687717 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-06c625c0-23f0-4cba-a3fe-e9b4b6a5399c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: c004d7e4-71d3-418b-95f2-736cef250bdc] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:36:57.699379 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-06c625c0-23f0-4cba-a3fe-e9b4b6a5399c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:57.699799 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-06c625c0-23f0-4cba-a3fe-e9b4b6a5399c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:57.700578 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-06c625c0-23f0-4cba-a3fe-e9b4b6a5399c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:57.701022 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-06c625c0-23f0-4cba-a3fe-e9b4b6a5399c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:57.767989 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-06c625c0-23f0-4cba-a3fe-e9b4b6a5399c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:36:57.775821 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-06c625c0-23f0-4cba-a3fe-e9b4b6a5399c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc" status: 200 len: 1210 microversion: 2.1 time: 0.094207 Jun 14 18:36:57.776499 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 506/1035] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:36:57 2022] GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc => generated 1210 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:36:58.794471 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-9ec71e16-28a0-4723-92ab-2ffe3ce087bd tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:36:58.795155 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-9ec71e16-28a0-4723-92ab-2ffe3ce087bd tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: c004d7e4-71d3-418b-95f2-736cef250bdc] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:36:58.801925 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9ec71e16-28a0-4723-92ab-2ffe3ce087bd tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:58.802373 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9ec71e16-28a0-4723-92ab-2ffe3ce087bd tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:58.803139 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9ec71e16-28a0-4723-92ab-2ffe3ce087bd tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:58.803573 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9ec71e16-28a0-4723-92ab-2ffe3ce087bd tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:59.046366 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-9ec71e16-28a0-4723-92ab-2ffe3ce087bd tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:36:59.054378 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-9ec71e16-28a0-4723-92ab-2ffe3ce087bd tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc" status: 200 len: 1278 microversion: 2.1 time: 0.263757 Jun 14 18:36:59.054957 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 530/1036] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:36:58 2022] GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc => generated 1278 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:36:59.266456 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-d60dbb45-0eee-49d0-ab71-193c70ee5c61 req-fb85d1bd-2f41-4d95-803a-567cc423b0d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c004d7e4-71d3-418b-95f2-736cef250bdc", "tag": "3016db14-1b36-475d-ba0c-3b43b39e932c"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:36:59.276407 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-d60dbb45-0eee-49d0-ab71-193c70ee5c61 req-fb85d1bd-2f41-4d95-803a-567cc423b0d9 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:36:59.276744 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-d60dbb45-0eee-49d0-ab71-193c70ee5c61 req-fb85d1bd-2f41-4d95-803a-567cc423b0d9 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:36:59.296756 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-d60dbb45-0eee-49d0-ab71-193c70ee5c61 req-fb85d1bd-2f41-4d95-803a-567cc423b0d9 service nova] Creating event network-changed:3016db14-1b36-475d-ba0c-3b43b39e932c for instance c004d7e4-71d3-418b-95f2-736cef250bdc on hv-cinder-84456 Jun 14 18:36:59.302502 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-d60dbb45-0eee-49d0-ab71-193c70ee5c61 req-fb85d1bd-2f41-4d95-803a-567cc423b0d9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040001 Jun 14 18:36:59.302998 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 507/1037] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:37:00.071550 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-eafcc079-3da7-42ea-ad73-cc270abc1cd9 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:00.072226 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-eafcc079-3da7-42ea-ad73-cc270abc1cd9 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: c004d7e4-71d3-418b-95f2-736cef250bdc] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:00.079668 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-eafcc079-3da7-42ea-ad73-cc270abc1cd9 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:00.080728 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-eafcc079-3da7-42ea-ad73-cc270abc1cd9 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:00.080904 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-eafcc079-3da7-42ea-ad73-cc270abc1cd9 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:00.081287 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-eafcc079-3da7-42ea-ad73-cc270abc1cd9 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:00.377639 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-eafcc079-3da7-42ea-ad73-cc270abc1cd9 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:00.385346 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-eafcc079-3da7-42ea-ad73-cc270abc1cd9 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc" status: 200 len: 1266 microversion: 2.1 time: 0.317656 Jun 14 18:37:00.386586 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 531/1038] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:00 2022] GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc => generated 1266 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:00.974238 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-a9021300-976c-4f0b-b266-4b2ce833a295 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:00.974813 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-a9021300-976c-4f0b-b266-4b2ce833a295 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 5010e30a-74b2-48c7-9200-8bcd689ae716] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:00.981070 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a9021300-976c-4f0b-b266-4b2ce833a295 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:00.981545 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a9021300-976c-4f0b-b266-4b2ce833a295 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:00.982347 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a9021300-976c-4f0b-b266-4b2ce833a295 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:00.983311 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a9021300-976c-4f0b-b266-4b2ce833a295 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:01.175646 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.objects.instance [None req-a9021300-976c-4f0b-b266-4b2ce833a295 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lazy-loading 'services' on Instance uuid 5010e30a-74b2-48c7-9200-8bcd689ae716 {{(pid=118623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:37:01.403529 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-2ffdb947-229f-4fd7-a2f9-362c1933375e tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:01.405033 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-2ffdb947-229f-4fd7-a2f9-362c1933375e tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: c004d7e4-71d3-418b-95f2-736cef250bdc] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:01.412777 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2ffdb947-229f-4fd7-a2f9-362c1933375e tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:01.413278 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2ffdb947-229f-4fd7-a2f9-362c1933375e tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:01.414066 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2ffdb947-229f-4fd7-a2f9-362c1933375e tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:01.414505 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2ffdb947-229f-4fd7-a2f9-362c1933375e tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:01.432336 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-a9021300-976c-4f0b-b266-4b2ce833a295 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716/os-volume_attachments/eb897aa8-7892-4640-8ae0-d51e8234e06d" status: 202 len: 0 microversion: 2.1 time: 0.462454 Jun 14 18:37:01.433407 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 508/1039] 10.222.0.78 () {58 vars in 1415 bytes} [Tue Jun 14 18:37:00 2022] DELETE /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716/os-volume_attachments/eb897aa8-7892-4640-8ae0-d51e8234e06d => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:37:01.598913 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-2ffdb947-229f-4fd7-a2f9-362c1933375e tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:01.608085 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-2ffdb947-229f-4fd7-a2f9-362c1933375e tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc" status: 200 len: 1266 microversion: 2.1 time: 0.208370 Jun 14 18:37:01.611634 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 532/1040] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:01 2022] GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:37:02.627114 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-90ec6014-6d6f-4fed-b844-579dd6de6d9d tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:02.628016 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-90ec6014-6d6f-4fed-b844-579dd6de6d9d tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: c004d7e4-71d3-418b-95f2-736cef250bdc] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:02.634561 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-90ec6014-6d6f-4fed-b844-579dd6de6d9d tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:02.635012 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-90ec6014-6d6f-4fed-b844-579dd6de6d9d tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:02.635781 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-90ec6014-6d6f-4fed-b844-579dd6de6d9d tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:02.636217 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-90ec6014-6d6f-4fed-b844-579dd6de6d9d tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:02.781885 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-90ec6014-6d6f-4fed-b844-579dd6de6d9d tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:02.795249 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-90ec6014-6d6f-4fed-b844-579dd6de6d9d tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc" status: 200 len: 1266 microversion: 2.1 time: 0.173125 Jun 14 18:37:02.796243 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 509/1041] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:02 2022] GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:03.814340 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-2e13f45f-e9bf-4d52-92de-460efaa3f90b tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:03.814942 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-2e13f45f-e9bf-4d52-92de-460efaa3f90b tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: c004d7e4-71d3-418b-95f2-736cef250bdc] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:03.820981 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2e13f45f-e9bf-4d52-92de-460efaa3f90b tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:03.821426 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2e13f45f-e9bf-4d52-92de-460efaa3f90b tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:03.822214 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2e13f45f-e9bf-4d52-92de-460efaa3f90b tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:03.822643 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2e13f45f-e9bf-4d52-92de-460efaa3f90b tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:03.958307 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-2e13f45f-e9bf-4d52-92de-460efaa3f90b tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:03.966234 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-2e13f45f-e9bf-4d52-92de-460efaa3f90b tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc" status: 200 len: 1266 microversion: 2.1 time: 0.156216 Jun 14 18:37:03.967399 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 533/1042] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:03 2022] GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:04.984794 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-c8ad38f8-7e53-49cc-afdb-62a1dca2a7bb tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:04.985335 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-c8ad38f8-7e53-49cc-afdb-62a1dca2a7bb tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: c004d7e4-71d3-418b-95f2-736cef250bdc] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:04.992337 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c8ad38f8-7e53-49cc-afdb-62a1dca2a7bb tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:04.992788 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c8ad38f8-7e53-49cc-afdb-62a1dca2a7bb tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:04.993637 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c8ad38f8-7e53-49cc-afdb-62a1dca2a7bb tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:04.994112 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-c8ad38f8-7e53-49cc-afdb-62a1dca2a7bb tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:05.132656 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-c8ad38f8-7e53-49cc-afdb-62a1dca2a7bb tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:05.140268 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-c8ad38f8-7e53-49cc-afdb-62a1dca2a7bb tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc" status: 200 len: 1266 microversion: 2.1 time: 0.160205 Jun 14 18:37:05.140822 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 510/1043] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:04 2022] GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:06.157429 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-701369c2-df2d-49be-8910-86465ad2365c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:06.158084 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-701369c2-df2d-49be-8910-86465ad2365c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: c004d7e4-71d3-418b-95f2-736cef250bdc] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:06.160526 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell0:SELECT=2 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:37:06.161262 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell0:SELECT=6 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:37:06.166379 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-701369c2-df2d-49be-8910-86465ad2365c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:06.166875 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-701369c2-df2d-49be-8910-86465ad2365c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:06.167655 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-701369c2-df2d-49be-8910-86465ad2365c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:06.168092 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-701369c2-df2d-49be-8910-86465ad2365c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:06.304971 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-701369c2-df2d-49be-8910-86465ad2365c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:06.313045 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-701369c2-df2d-49be-8910-86465ad2365c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc" status: 200 len: 1266 microversion: 2.1 time: 0.160444 Jun 14 18:37:06.313800 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 534/1044] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:06 2022] GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:07.329825 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-f5229b20-feaf-4c59-b17f-2ea22a3dad66 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:07.330512 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-f5229b20-feaf-4c59-b17f-2ea22a3dad66 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: c004d7e4-71d3-418b-95f2-736cef250bdc] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:07.332600 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell0:SELECT=2 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:37:07.337569 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f5229b20-feaf-4c59-b17f-2ea22a3dad66 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:07.338012 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f5229b20-feaf-4c59-b17f-2ea22a3dad66 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:07.338779 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f5229b20-feaf-4c59-b17f-2ea22a3dad66 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:07.339211 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f5229b20-feaf-4c59-b17f-2ea22a3dad66 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:07.477835 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-f5229b20-feaf-4c59-b17f-2ea22a3dad66 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:07.485592 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-f5229b20-feaf-4c59-b17f-2ea22a3dad66 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc" status: 200 len: 1266 microversion: 2.1 time: 0.160224 Jun 14 18:37:07.486162 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 511/1045] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:07 2022] GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:08.502762 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-ddd29bd5-40cd-4867-bbc9-56bd8416c199 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:08.503379 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-ddd29bd5-40cd-4867-bbc9-56bd8416c199 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: c004d7e4-71d3-418b-95f2-736cef250bdc] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:08.510214 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ddd29bd5-40cd-4867-bbc9-56bd8416c199 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:08.510661 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ddd29bd5-40cd-4867-bbc9-56bd8416c199 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:08.511561 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ddd29bd5-40cd-4867-bbc9-56bd8416c199 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:08.512145 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ddd29bd5-40cd-4867-bbc9-56bd8416c199 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:08.650599 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-ddd29bd5-40cd-4867-bbc9-56bd8416c199 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:08.659055 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-ddd29bd5-40cd-4867-bbc9-56bd8416c199 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc" status: 200 len: 1266 microversion: 2.1 time: 0.160284 Jun 14 18:37:08.659626 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 535/1046] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:08 2022] GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:09.676420 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-27235636-7b03-4e81-9e7c-70aa65b7efd5 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:09.677021 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-27235636-7b03-4e81-9e7c-70aa65b7efd5 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: c004d7e4-71d3-418b-95f2-736cef250bdc] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:09.683604 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-27235636-7b03-4e81-9e7c-70aa65b7efd5 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:09.684046 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-27235636-7b03-4e81-9e7c-70aa65b7efd5 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:09.684803 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-27235636-7b03-4e81-9e7c-70aa65b7efd5 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:09.685232 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-27235636-7b03-4e81-9e7c-70aa65b7efd5 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:09.819336 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-27235636-7b03-4e81-9e7c-70aa65b7efd5 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:09.828034 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-27235636-7b03-4e81-9e7c-70aa65b7efd5 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc" status: 200 len: 1266 microversion: 2.1 time: 0.155714 Jun 14 18:37:09.828606 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 512/1047] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:09 2022] GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:10.845797 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-31f439c2-6401-4d3d-8e48-4dedcb8f7254 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:10.846406 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-31f439c2-6401-4d3d-8e48-4dedcb8f7254 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: c004d7e4-71d3-418b-95f2-736cef250bdc] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:10.854054 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-31f439c2-6401-4d3d-8e48-4dedcb8f7254 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:10.854554 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-31f439c2-6401-4d3d-8e48-4dedcb8f7254 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:10.855484 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-31f439c2-6401-4d3d-8e48-4dedcb8f7254 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:10.855993 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-31f439c2-6401-4d3d-8e48-4dedcb8f7254 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:11.013824 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-31f439c2-6401-4d3d-8e48-4dedcb8f7254 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:11.022527 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-31f439c2-6401-4d3d-8e48-4dedcb8f7254 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc" status: 200 len: 1266 microversion: 2.1 time: 0.180801 Jun 14 18:37:11.023512 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 536/1048] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:10 2022] GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:37:12.039994 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-b073a886-7ae6-49c0-841d-83825187e16d tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:12.040629 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-b073a886-7ae6-49c0-841d-83825187e16d tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: c004d7e4-71d3-418b-95f2-736cef250bdc] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:12.047553 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b073a886-7ae6-49c0-841d-83825187e16d tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:12.047993 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b073a886-7ae6-49c0-841d-83825187e16d tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:12.048761 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b073a886-7ae6-49c0-841d-83825187e16d tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:12.049190 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b073a886-7ae6-49c0-841d-83825187e16d tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:12.213169 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-b073a886-7ae6-49c0-841d-83825187e16d tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:12.221040 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-b073a886-7ae6-49c0-841d-83825187e16d tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc" status: 200 len: 1266 microversion: 2.1 time: 0.185551 Jun 14 18:37:12.221624 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 513/1049] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:12 2022] GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:13.238707 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-a324312e-7e4f-4030-a4c0-9c8cbd0b0685 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:13.239319 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-a324312e-7e4f-4030-a4c0-9c8cbd0b0685 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: c004d7e4-71d3-418b-95f2-736cef250bdc] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:13.245878 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a324312e-7e4f-4030-a4c0-9c8cbd0b0685 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:13.246328 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a324312e-7e4f-4030-a4c0-9c8cbd0b0685 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:13.247799 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a324312e-7e4f-4030-a4c0-9c8cbd0b0685 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:13.248260 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a324312e-7e4f-4030-a4c0-9c8cbd0b0685 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:13.379600 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-a324312e-7e4f-4030-a4c0-9c8cbd0b0685 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:13.387255 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-a324312e-7e4f-4030-a4c0-9c8cbd0b0685 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc" status: 200 len: 1266 microversion: 2.1 time: 0.152776 Jun 14 18:37:13.387913 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 537/1050] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:13 2022] GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:14.404408 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-e3704cc8-98f8-4da9-9e74-7d6cab40253f tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:14.405037 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-e3704cc8-98f8-4da9-9e74-7d6cab40253f tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: c004d7e4-71d3-418b-95f2-736cef250bdc] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:14.411813 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e3704cc8-98f8-4da9-9e74-7d6cab40253f tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:14.412255 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e3704cc8-98f8-4da9-9e74-7d6cab40253f tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:14.413013 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e3704cc8-98f8-4da9-9e74-7d6cab40253f tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:14.413495 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e3704cc8-98f8-4da9-9e74-7d6cab40253f tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:14.546764 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-e3704cc8-98f8-4da9-9e74-7d6cab40253f tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:14.554371 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-e3704cc8-98f8-4da9-9e74-7d6cab40253f tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc" status: 200 len: 1266 microversion: 2.1 time: 0.154055 Jun 14 18:37:14.554939 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 514/1051] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:14 2022] GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:15.333893 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-c5d8f9ea-547c-44e6-abd3-6c7671741ff9 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:15.334421 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-c5d8f9ea-547c-44e6-abd3-6c7671741ff9 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 5010e30a-74b2-48c7-9200-8bcd689ae716] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:15.342209 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c5d8f9ea-547c-44e6-abd3-6c7671741ff9 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:15.342665 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c5d8f9ea-547c-44e6-abd3-6c7671741ff9 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:15.343457 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c5d8f9ea-547c-44e6-abd3-6c7671741ff9 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:15.343898 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-c5d8f9ea-547c-44e6-abd3-6c7671741ff9 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:15.375022 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-c5d8f9ea-547c-44e6-abd3-6c7671741ff9 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 5010e30a-74b2-48c7-9200-8bcd689ae716] Going to try to terminate instance {{(pid=118624) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:37:15.572324 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-3ff2ccc9-f694-4b46-b433-3e659e336773 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:15.572934 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-3ff2ccc9-f694-4b46-b433-3e659e336773 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: c004d7e4-71d3-418b-95f2-736cef250bdc] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:15.580600 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3ff2ccc9-f694-4b46-b433-3e659e336773 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:15.581040 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3ff2ccc9-f694-4b46-b433-3e659e336773 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:15.581874 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3ff2ccc9-f694-4b46-b433-3e659e336773 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:15.582267 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3ff2ccc9-f694-4b46-b433-3e659e336773 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:15.719550 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-3ff2ccc9-f694-4b46-b433-3e659e336773 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:15.727383 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-3ff2ccc9-f694-4b46-b433-3e659e336773 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc" status: 200 len: 1266 microversion: 2.1 time: 0.159056 Jun 14 18:37:15.727872 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 515/1052] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:15 2022] GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:37:15.750605 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-c5d8f9ea-547c-44e6-abd3-6c7671741ff9 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716" status: 204 len: 0 microversion: 2.1 time: 0.420474 Jun 14 18:37:15.751192 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 538/1053] 10.222.0.78 () {58 vars in 1238 bytes} [Tue Jun 14 18:37:15 2022] DELETE /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 18:37:15.767000 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-a14d34c8-e045-4932-a758-e72c326cd30c tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:15.767617 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-a14d34c8-e045-4932-a758-e72c326cd30c tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 5010e30a-74b2-48c7-9200-8bcd689ae716] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:15.773713 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a14d34c8-e045-4932-a758-e72c326cd30c tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:15.774166 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a14d34c8-e045-4932-a758-e72c326cd30c tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:15.774933 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a14d34c8-e045-4932-a758-e72c326cd30c tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:15.775368 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a14d34c8-e045-4932-a758-e72c326cd30c tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:15.916796 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-a14d34c8-e045-4932-a758-e72c326cd30c tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f183ac34806e46bca89a6c99a8cb62d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f290418a3e42ba962a70a5af666a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:15.924832 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-a14d34c8-e045-4932-a758-e72c326cd30c tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] 10.222.0.78 "GET /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716" status: 200 len: 1515 microversion: 2.1 time: 0.162172 Jun 14 18:37:15.925380 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 516/1054] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:15 2022] GET /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:16.745002 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-654aa5b6-3869-4810-874b-4415b3ddda70 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:16.746358 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-654aa5b6-3869-4810-874b-4415b3ddda70 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: c004d7e4-71d3-418b-95f2-736cef250bdc] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:16.752743 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-654aa5b6-3869-4810-874b-4415b3ddda70 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:16.753189 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-654aa5b6-3869-4810-874b-4415b3ddda70 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:16.753989 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-654aa5b6-3869-4810-874b-4415b3ddda70 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:16.754424 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-654aa5b6-3869-4810-874b-4415b3ddda70 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:16.907851 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-654aa5b6-3869-4810-874b-4415b3ddda70 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:16.922597 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-654aa5b6-3869-4810-874b-4415b3ddda70 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc" status: 200 len: 1266 microversion: 2.1 time: 0.181586 Jun 14 18:37:16.923668 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 539/1055] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:16 2022] GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:16.943609 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-d1a0d803-80c7-4950-b016-6226e746eebb tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:16.945326 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-d1a0d803-80c7-4950-b016-6226e746eebb tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 5010e30a-74b2-48c7-9200-8bcd689ae716] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:16.952851 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d1a0d803-80c7-4950-b016-6226e746eebb tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:16.953649 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d1a0d803-80c7-4950-b016-6226e746eebb tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:16.954425 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d1a0d803-80c7-4950-b016-6226e746eebb tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:16.954859 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d1a0d803-80c7-4950-b016-6226e746eebb tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:17.096839 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-d1a0d803-80c7-4950-b016-6226e746eebb tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f183ac34806e46bca89a6c99a8cb62d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f290418a3e42ba962a70a5af666a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:17.104434 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-d1a0d803-80c7-4950-b016-6226e746eebb tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] 10.222.0.78 "GET /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716" status: 200 len: 1515 microversion: 2.1 time: 0.166114 Jun 14 18:37:17.104986 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 517/1056] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:16 2022] GET /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:17.941240 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-31daf742-0030-42f0-acc9-87a2698b20fa tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:17.941967 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-31daf742-0030-42f0-acc9-87a2698b20fa tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: c004d7e4-71d3-418b-95f2-736cef250bdc] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:17.948759 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-31daf742-0030-42f0-acc9-87a2698b20fa tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:17.949207 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-31daf742-0030-42f0-acc9-87a2698b20fa tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:17.950009 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-31daf742-0030-42f0-acc9-87a2698b20fa tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:17.950454 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-31daf742-0030-42f0-acc9-87a2698b20fa tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:18.116510 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-9dd6d1c5-c682-4fde-9350-3bde0a388b62 req-e8f0699b-fbc0-4c29-985f-b1e4693b940f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5010e30a-74b2-48c7-9200-8bcd689ae716", "name": "network-vif-deleted", "tag": "c4e3043d-10d0-4d1c-922a-cab5ae2a715a"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:37:18.127600 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-9dd6d1c5-c682-4fde-9350-3bde0a388b62 req-e8f0699b-fbc0-4c29-985f-b1e4693b940f service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:18.128041 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-9dd6d1c5-c682-4fde-9350-3bde0a388b62 req-e8f0699b-fbc0-4c29-985f-b1e4693b940f service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:18.140682 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-9dd6d1c5-c682-4fde-9350-3bde0a388b62 req-e8f0699b-fbc0-4c29-985f-b1e4693b940f service nova] Creating event network-vif-deleted:c4e3043d-10d0-4d1c-922a-cab5ae2a715a for instance 5010e30a-74b2-48c7-9200-8bcd689ae716 on hv-cinder-84456 Jun 14 18:37:18.146282 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-9dd6d1c5-c682-4fde-9350-3bde0a388b62 req-e8f0699b-fbc0-4c29-985f-b1e4693b940f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034425 Jun 14 18:37:18.146898 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 518/1057] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:37:18.152447 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-45f6c405-21f3-473d-9dd9-e55d1ac38097 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:18.163908 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-31daf742-0030-42f0-acc9-87a2698b20fa tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:18.164700 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-45f6c405-21f3-473d-9dd9-e55d1ac38097 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 5010e30a-74b2-48c7-9200-8bcd689ae716] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:18.172311 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-45f6c405-21f3-473d-9dd9-e55d1ac38097 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:18.172766 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-45f6c405-21f3-473d-9dd9-e55d1ac38097 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:18.173047 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-31daf742-0030-42f0-acc9-87a2698b20fa tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc" status: 200 len: 1266 microversion: 2.1 time: 0.235772 Jun 14 18:37:18.173868 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-45f6c405-21f3-473d-9dd9-e55d1ac38097 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:18.173994 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 540/1058] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:17 2022] GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:18.174107 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-45f6c405-21f3-473d-9dd9-e55d1ac38097 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:18.252752 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-45f6c405-21f3-473d-9dd9-e55d1ac38097 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f183ac34806e46bca89a6c99a8cb62d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f290418a3e42ba962a70a5af666a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:18.260570 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-45f6c405-21f3-473d-9dd9-e55d1ac38097 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] 10.222.0.78 "GET /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716" status: 200 len: 1473 microversion: 2.1 time: 0.112388 Jun 14 18:37:18.261164 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 519/1059] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:18 2022] GET /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716 => generated 1473 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:19.142237 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-4b884c10-8f9b-41f1-9861-6c81fd097c1b req-63a4f712-9558-45e4-9e15-f0c356773151 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c004d7e4-71d3-418b-95f2-736cef250bdc", "name": "network-vif-plugged", "status": "completed", "tag": "3016db14-1b36-475d-ba0c-3b43b39e932c"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:37:19.151469 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-4b884c10-8f9b-41f1-9861-6c81fd097c1b req-63a4f712-9558-45e4-9e15-f0c356773151 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:19.151913 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-4b884c10-8f9b-41f1-9861-6c81fd097c1b req-63a4f712-9558-45e4-9e15-f0c356773151 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:19.165949 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-4b884c10-8f9b-41f1-9861-6c81fd097c1b req-63a4f712-9558-45e4-9e15-f0c356773151 service nova] Creating event network-vif-plugged:3016db14-1b36-475d-ba0c-3b43b39e932c for instance c004d7e4-71d3-418b-95f2-736cef250bdc on hv-cinder-84456 Jun 14 18:37:19.172225 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-4b884c10-8f9b-41f1-9861-6c81fd097c1b req-63a4f712-9558-45e4-9e15-f0c356773151 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035158 Jun 14 18:37:19.172844 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 541/1060] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:37:19.191408 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-1399d37e-d716-4bb3-b8af-f3e6dd81a382 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:19.192027 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-1399d37e-d716-4bb3-b8af-f3e6dd81a382 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: c004d7e4-71d3-418b-95f2-736cef250bdc] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:19.198886 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1399d37e-d716-4bb3-b8af-f3e6dd81a382 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:19.199338 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1399d37e-d716-4bb3-b8af-f3e6dd81a382 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:19.200321 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1399d37e-d716-4bb3-b8af-f3e6dd81a382 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:19.200772 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1399d37e-d716-4bb3-b8af-f3e6dd81a382 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:19.278094 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-6771c6e3-a84f-428f-96b5-988d2d7741a4 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:19.278797 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-6771c6e3-a84f-428f-96b5-988d2d7741a4 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 5010e30a-74b2-48c7-9200-8bcd689ae716] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:19.285941 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6771c6e3-a84f-428f-96b5-988d2d7741a4 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:19.286302 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6771c6e3-a84f-428f-96b5-988d2d7741a4 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:19.287589 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6771c6e3-a84f-428f-96b5-988d2d7741a4 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:19.288249 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6771c6e3-a84f-428f-96b5-988d2d7741a4 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:19.308193 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.wsgi [None req-6771c6e3-a84f-428f-96b5-988d2d7741a4 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] HTTP exception thrown: Instance 5010e30a-74b2-48c7-9200-8bcd689ae716 could not be found. Jun 14 18:37:19.309920 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-6771c6e3-a84f-428f-96b5-988d2d7741a4 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Request method failure captured: Jun 14 18:37:19.309920 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: request: GET /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716 HTTP/1.1 Jun 14 18:37:19.309920 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept: application/json Jun 14 18:37:19.309920 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept-Encoding: identity Jun 14 18:37:19.309920 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Connection: close Jun 14 18:37:19.309920 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Length: 0 Jun 14 18:37:19.309920 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Type: application/json Jun 14 18:37:19.309920 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Host: 10.222.0.78 Jun 14 18:37:19.309920 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Openstack-System-Scope: None Jun 14 18:37:19.309920 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: User-Agent: python-urllib3/1.26.9 Jun 14 18:37:19.309920 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Auth-Token: gAAAAABiqNUKS5KQoQZ9mPHmvh270iFLKovjMybDY2Rh4a_B-3kR9dS4FLtzSsC09e8GKM4DymiU81ygOaZJ_Jl3QtEePim0J5WN3mgSZC4xiereL6zkcNSz0WFZR5BqbWgr6ua08ZiZjmHcUaXyizF1hCOwYOpoe6FOP-Hv84hTf_f8uaQWlI0 Jun 14 18:37:19.309920 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Id: None Jun 14 18:37:19.309920 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Name: None Jun 14 18:37:19.309920 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Identity-Status: Confirmed Jun 14 18:37:19.309920 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Is-Admin-Project: True Jun 14 18:37:19.309920 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Id: default Jun 14 18:37:19.309920 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Name: Default Jun 14 18:37:19.309920 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Id: 64f290418a3e42ba962a70a5af666a9d Jun 14 18:37:19.309920 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1941290998 Jun 14 18:37:19.309920 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Role: reader,member Jun 14 18:37:19.309920 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Roles: reader,member Jun 14 18:37:19.312014 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_64f290418a3e42ba962a70a5af666a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/64f290418a3e42ba962a70a5af666a9d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/64f290418a3e42ba962a70a5af666a9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/64f290418a3e42ba962a70a5af666a9d"}]}] Jun 14 18:37:19.312014 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant: tempest-VolumesSnapshotTestJSON-1941290998 Jun 14 18:37:19.312014 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Id: 64f290418a3e42ba962a70a5af666a9d Jun 14 18:37:19.312014 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1941290998 Jun 14 18:37:19.312014 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User: tempest-VolumesSnapshotTestJSON-1941290998-project Jun 14 18:37:19.312014 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Id: default Jun 14 18:37:19.312014 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Name: Default Jun 14 18:37:19.312014 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Id: f183ac34806e46bca89a6c99a8cb62d4 Jun 14 18:37:19.312014 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Name: tempest-VolumesSnapshotTestJSON-1941290998-project Jun 14 18:37:19.312014 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: method: > Jun 14 18:37:19.312014 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: exception: Instance 5010e30a-74b2-48c7-9200-8bcd689ae716 could not be found. Jun 14 18:37:19.312014 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: action_args: {'id': '5010e30a-74b2-48c7-9200-8bcd689ae716'} Jun 14 18:37:19.312810 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:37:19.312810 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:37:19.312810 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:37:19.312810 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:37:19.312810 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:37:19.312810 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:37:19.312810 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:37:19.312810 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:37:19.312810 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:37:19.312810 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:37:19.312810 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5010e30a-74b2-48c7-9200-8bcd689ae716 could not be found. Jun 14 18:37:19.312810 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:37:19.312810 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:37:19.312810 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:37:19.312810 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:37:19.312810 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:37:19.312810 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:37:19.312810 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:37:19.312810 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:37:19.312810 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:37:19.314822 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:37:19.314822 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:37:19.314822 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:37:19.314822 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:37:19.314822 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:37:19.314822 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:37:19.314822 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:37:19.314822 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5010e30a-74b2-48c7-9200-8bcd689ae716 could not be found. Jun 14 18:37:19.314822 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:37:19.314822 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:37:19.314822 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:37:19.314822 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:37:19.314822 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:37:19.314822 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:37:19.314822 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:37:19.314822 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:37:19.314822 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5010e30a-74b2-48c7-9200-8bcd689ae716 could not be found. Jun 14 18:37:19.314822 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:37:19.316630 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-6771c6e3-a84f-428f-96b5-988d2d7741a4 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Returning 404 to user: Instance 5010e30a-74b2-48c7-9200-8bcd689ae716 could not be found. {{(pid=118624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:37:19.316630 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-6771c6e3-a84f-428f-96b5-988d2d7741a4 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] 10.222.0.78 "GET /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716" status: 404 len: 111 microversion: 2.1 time: 0.038252 Jun 14 18:37:19.316630 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 542/1061] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:19 2022] GET /compute/v2.1/servers/5010e30a-74b2-48c7-9200-8bcd689ae716 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 14 18:37:19.353495 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-1399d37e-d716-4bb3-b8af-f3e6dd81a382 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:19.361024 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-1399d37e-d716-4bb3-b8af-f3e6dd81a382 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc" status: 200 len: 1266 microversion: 2.1 time: 0.173429 Jun 14 18:37:19.361818 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 520/1062] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:19 2022] GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:37:20.377778 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-9b26074e-1d79-46bf-99bb-82523301a510 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:20.378456 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-9b26074e-1d79-46bf-99bb-82523301a510 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: c004d7e4-71d3-418b-95f2-736cef250bdc] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:20.385052 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9b26074e-1d79-46bf-99bb-82523301a510 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:20.385545 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9b26074e-1d79-46bf-99bb-82523301a510 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:20.386325 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9b26074e-1d79-46bf-99bb-82523301a510 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:20.386765 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-9b26074e-1d79-46bf-99bb-82523301a510 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:20.574392 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-9b26074e-1d79-46bf-99bb-82523301a510 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:20.583502 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-9b26074e-1d79-46bf-99bb-82523301a510 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc" status: 200 len: 1266 microversion: 2.1 time: 0.209597 Jun 14 18:37:20.584086 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 543/1063] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:20 2022] GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:37:21.602322 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-fb62e14d-ac18-4c75-b767-4a6e8ead8c9d tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:21.603057 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-fb62e14d-ac18-4c75-b767-4a6e8ead8c9d tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: c004d7e4-71d3-418b-95f2-736cef250bdc] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:21.610224 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-fb62e14d-ac18-4c75-b767-4a6e8ead8c9d tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:21.610702 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-fb62e14d-ac18-4c75-b767-4a6e8ead8c9d tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:21.611445 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-fb62e14d-ac18-4c75-b767-4a6e8ead8c9d tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:21.611875 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-fb62e14d-ac18-4c75-b767-4a6e8ead8c9d tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:21.760267 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-fb62e14d-ac18-4c75-b767-4a6e8ead8c9d tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:21.768342 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-fb62e14d-ac18-4c75-b767-4a6e8ead8c9d tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc" status: 200 len: 1266 microversion: 2.1 time: 0.170826 Jun 14 18:37:21.777298 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 521/1064] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:21 2022] GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:22.786541 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-b383c38a-4dc9-4ad1-841a-da801f1a4277 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:22.787141 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-b383c38a-4dc9-4ad1-841a-da801f1a4277 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: c004d7e4-71d3-418b-95f2-736cef250bdc] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:22.794174 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b383c38a-4dc9-4ad1-841a-da801f1a4277 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:22.794688 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b383c38a-4dc9-4ad1-841a-da801f1a4277 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:22.795501 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b383c38a-4dc9-4ad1-841a-da801f1a4277 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:22.796411 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b383c38a-4dc9-4ad1-841a-da801f1a4277 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:22.989949 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-b383c38a-4dc9-4ad1-841a-da801f1a4277 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:23.008594 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:37:23.018840 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-b383c38a-4dc9-4ad1-841a-da801f1a4277 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc" status: 200 len: 1266 microversion: 2.1 time: 0.234315 Jun 14 18:37:23.020049 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 544/1065] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:22 2022] GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:24.036845 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-88887632-6730-4c31-acd4-3c8fc4c7f2bc tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:24.041340 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-88887632-6730-4c31-acd4-3c8fc4c7f2bc tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: c004d7e4-71d3-418b-95f2-736cef250bdc] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:24.045288 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-88887632-6730-4c31-acd4-3c8fc4c7f2bc tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:24.046022 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-88887632-6730-4c31-acd4-3c8fc4c7f2bc tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:24.046809 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-88887632-6730-4c31-acd4-3c8fc4c7f2bc tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:24.047330 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-88887632-6730-4c31-acd4-3c8fc4c7f2bc tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:24.198086 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-88887632-6730-4c31-acd4-3c8fc4c7f2bc tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:24.205770 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-88887632-6730-4c31-acd4-3c8fc4c7f2bc tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc" status: 200 len: 1453 microversion: 2.1 time: 0.172951 Jun 14 18:37:24.206340 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 522/1066] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:24 2022] GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc => generated 1453 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:24.223712 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-525f9ac3-782e-4f29-b7e6-59cd2bf89cde tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:24.224323 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-525f9ac3-782e-4f29-b7e6-59cd2bf89cde tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: c004d7e4-71d3-418b-95f2-736cef250bdc] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:24.231089 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-525f9ac3-782e-4f29-b7e6-59cd2bf89cde tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:24.242274 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-525f9ac3-782e-4f29-b7e6-59cd2bf89cde tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:24.242274 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-525f9ac3-782e-4f29-b7e6-59cd2bf89cde tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:24.242274 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-525f9ac3-782e-4f29-b7e6-59cd2bf89cde tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:24.370862 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-525f9ac3-782e-4f29-b7e6-59cd2bf89cde tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:24.378849 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-525f9ac3-782e-4f29-b7e6-59cd2bf89cde tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc" status: 200 len: 1453 microversion: 2.1 time: 0.159577 Jun 14 18:37:24.379452 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 545/1067] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:24 2022] GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:25.239252 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-d1169958-0cda-4d2a-8f35-5eb69d00b451 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-916280896", "imageRef": "e2555120-8576-4128-944f-40805aa95a9b", "flavorRef": "452"}} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:37:25.330942 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.network.neutron [None req-d1169958-0cda-4d2a-8f35-5eb69d00b451 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] validate_networks() for None {{(pid=118623) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 18:37:26.123750 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-d1169958-0cda-4d2a-8f35-5eb69d00b451 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Flavor limits 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 18:37:26.124193 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-d1169958-0cda-4d2a-8f35-5eb69d00b451 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Image limits 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 18:37:26.124672 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-d1169958-0cda-4d2a-8f35-5eb69d00b451 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Flavor pref 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 18:37:26.125289 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-d1169958-0cda-4d2a-8f35-5eb69d00b451 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Image pref 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 18:37:26.125738 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-d1169958-0cda-4d2a-8f35-5eb69d00b451 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 18:37:26.127927 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_api:SELECT=41 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:37:26.136740 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d1169958-0cda-4d2a-8f35-5eb69d00b451 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:26.137212 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d1169958-0cda-4d2a-8f35-5eb69d00b451 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:26.141694 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d1169958-0cda-4d2a-8f35-5eb69d00b451 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:26.141694 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-d1169958-0cda-4d2a-8f35-5eb69d00b451 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:26.147376 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:37:26.161536 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.quota [None req-d1169958-0cda-4d2a-8f35-5eb69d00b451 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Getting quotas for project 02dffb25bc1545c1aef7d52265daadc2. Resources: {'instances', 'cores', 'ram'} {{(pid=118623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:37:26.166333 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.quota [None req-d1169958-0cda-4d2a-8f35-5eb69d00b451 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Getting quotas for user bcebcd9a9d1e40089ded0c963a2ac1b4 and project 02dffb25bc1545c1aef7d52265daadc2. Resources: {'instances', 'cores', 'ram'} {{(pid=118623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:37:26.179962 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-d1169958-0cda-4d2a-8f35-5eb69d00b451 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Going to run 1 instances... {{(pid=118623) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 18:37:26.182369 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-d1169958-0cda-4d2a-8f35-5eb69d00b451 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] [instance: fc4001b7-e9c8-49b1-a97d-3fc4abde4baa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e2555120-8576-4128-944f-40805aa95a9b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118623) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 18:37:26.347157 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-d1169958-0cda-4d2a-8f35-5eb69d00b451 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.115877 Jun 14 18:37:26.349716 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 523/1068] 10.222.0.78 () {60 vars in 1146 bytes} [Tue Jun 14 18:37:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 14 18:37:26.364004 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-ce3e5a43-d8d2-4333-80cd-1c78c059ccb1 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:26.367247 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-ce3e5a43-d8d2-4333-80cd-1c78c059ccb1 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] [instance: fc4001b7-e9c8-49b1-a97d-3fc4abde4baa] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:26.371651 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:37:26.455121 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-ce3e5a43-d8d2-4333-80cd-1c78c059ccb1 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcebcd9a9d1e40089ded0c963a2ac1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dffb25bc1545c1aef7d52265daadc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:26.468777 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-ce3e5a43-d8d2-4333-80cd-1c78c059ccb1 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] 10.222.0.78 "GET /compute/v2.1/servers/fc4001b7-e9c8-49b1-a97d-3fc4abde4baa" status: 200 len: 1214 microversion: 2.1 time: 0.113689 Jun 14 18:37:26.470390 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 546/1069] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:26 2022] GET /compute/v2.1/servers/fc4001b7-e9c8-49b1-a97d-3fc4abde4baa => generated 1214 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:27.488604 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-3e8ba010-f0db-4622-aee0-78be55ae29fd tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:27.489300 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-3e8ba010-f0db-4622-aee0-78be55ae29fd tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] [instance: fc4001b7-e9c8-49b1-a97d-3fc4abde4baa] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:27.515821 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-d6221d24-fcf0-4890-9de1-03486e841e2b req-9bb986fe-7954-485d-b7c0-ef395910fb2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c004d7e4-71d3-418b-95f2-736cef250bdc", "tag": "3016db14-1b36-475d-ba0c-3b43b39e932c"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:37:27.524985 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-d6221d24-fcf0-4890-9de1-03486e841e2b req-9bb986fe-7954-485d-b7c0-ef395910fb2a service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:27.525433 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-d6221d24-fcf0-4890-9de1-03486e841e2b req-9bb986fe-7954-485d-b7c0-ef395910fb2a service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:27.539384 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-d6221d24-fcf0-4890-9de1-03486e841e2b req-9bb986fe-7954-485d-b7c0-ef395910fb2a service nova] Creating event network-changed:3016db14-1b36-475d-ba0c-3b43b39e932c for instance c004d7e4-71d3-418b-95f2-736cef250bdc on hv-cinder-84456 Jun 14 18:37:27.546842 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-d6221d24-fcf0-4890-9de1-03486e841e2b req-9bb986fe-7954-485d-b7c0-ef395910fb2a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.209701 Jun 14 18:37:27.546842 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 524/1070] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:37:27.547817 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-3e8ba010-f0db-4622-aee0-78be55ae29fd tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcebcd9a9d1e40089ded0c963a2ac1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dffb25bc1545c1aef7d52265daadc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:27.556284 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-3e8ba010-f0db-4622-aee0-78be55ae29fd tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] 10.222.0.78 "GET /compute/v2.1/servers/fc4001b7-e9c8-49b1-a97d-3fc4abde4baa" status: 200 len: 1214 microversion: 2.1 time: 0.073272 Jun 14 18:37:27.556883 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 547/1071] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:27 2022] GET /compute/v2.1/servers/fc4001b7-e9c8-49b1-a97d-3fc4abde4baa => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:28.579636 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-424d088e-033d-4a95-8e50-1fcbdf67a08d tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:28.580758 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-424d088e-033d-4a95-8e50-1fcbdf67a08d tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] [instance: fc4001b7-e9c8-49b1-a97d-3fc4abde4baa] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:28.588454 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-424d088e-033d-4a95-8e50-1fcbdf67a08d tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:28.588900 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-424d088e-033d-4a95-8e50-1fcbdf67a08d tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:28.589702 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-424d088e-033d-4a95-8e50-1fcbdf67a08d tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:28.590135 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-424d088e-033d-4a95-8e50-1fcbdf67a08d tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:28.679008 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-424d088e-033d-4a95-8e50-1fcbdf67a08d tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcebcd9a9d1e40089ded0c963a2ac1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dffb25bc1545c1aef7d52265daadc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:28.687576 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-424d088e-033d-4a95-8e50-1fcbdf67a08d tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] 10.222.0.78 "GET /compute/v2.1/servers/fc4001b7-e9c8-49b1-a97d-3fc4abde4baa" status: 200 len: 1210 microversion: 2.1 time: 0.116205 Jun 14 18:37:28.688191 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 525/1072] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:28 2022] GET /compute/v2.1/servers/fc4001b7-e9c8-49b1-a97d-3fc4abde4baa => generated 1210 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:29.470571 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-050ab70b-6b66-4445-b561-e820d1579600 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1704253672", "imageRef": "e2555120-8576-4128-944f-40805aa95a9b", "flavorRef": "452", "networks": [{"uuid": "b92bd074-bf0b-4285-9cfe-d2dccb2d2e20"}]}} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:37:29.525007 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.network.neutron [None req-050ab70b-6b66-4445-b561-e820d1579600 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] validate_networks() for [('b92bd074-bf0b-4285-9cfe-d2dccb2d2e20', None, None, None, None, None)] {{(pid=118624) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 18:37:29.712194 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-531b15b6-055e-42d5-80bc-6d794f4d07c1 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:29.713096 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-531b15b6-055e-42d5-80bc-6d794f4d07c1 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] [instance: fc4001b7-e9c8-49b1-a97d-3fc4abde4baa] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:29.721078 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-531b15b6-055e-42d5-80bc-6d794f4d07c1 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:29.721560 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-531b15b6-055e-42d5-80bc-6d794f4d07c1 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:29.724520 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-531b15b6-055e-42d5-80bc-6d794f4d07c1 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:29.724520 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-531b15b6-055e-42d5-80bc-6d794f4d07c1 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:29.795273 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-531b15b6-055e-42d5-80bc-6d794f4d07c1 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcebcd9a9d1e40089ded0c963a2ac1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dffb25bc1545c1aef7d52265daadc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:29.803085 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-531b15b6-055e-42d5-80bc-6d794f4d07c1 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] 10.222.0.78 "GET /compute/v2.1/servers/fc4001b7-e9c8-49b1-a97d-3fc4abde4baa" status: 200 len: 1272 microversion: 2.1 time: 0.094755 Jun 14 18:37:29.803888 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 526/1073] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:29 2022] GET /compute/v2.1/servers/fc4001b7-e9c8-49b1-a97d-3fc4abde4baa => generated 1272 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:37:30.026364 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-050ab70b-6b66-4445-b561-e820d1579600 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Flavor limits 0:0:0 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 18:37:30.026781 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-050ab70b-6b66-4445-b561-e820d1579600 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Image limits 0:0:0 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 18:37:30.027249 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-050ab70b-6b66-4445-b561-e820d1579600 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Flavor pref 0:0:0 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 18:37:30.027651 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-050ab70b-6b66-4445-b561-e820d1579600 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Image pref 0:0:0 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 18:37:30.028055 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.virt.hardware [None req-050ab70b-6b66-4445-b561-e820d1579600 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118624) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 18:37:30.039036 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-050ab70b-6b66-4445-b561-e820d1579600 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:30.039481 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-050ab70b-6b66-4445-b561-e820d1579600 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:30.040399 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-050ab70b-6b66-4445-b561-e820d1579600 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:30.040752 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-050ab70b-6b66-4445-b561-e820d1579600 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:30.059163 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.quota [None req-050ab70b-6b66-4445-b561-e820d1579600 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Getting quotas for project 64f290418a3e42ba962a70a5af666a9d. Resources: {'instances', 'cores', 'ram'} {{(pid=118624) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:37:30.063376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.quota [None req-050ab70b-6b66-4445-b561-e820d1579600 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Getting quotas for user f183ac34806e46bca89a6c99a8cb62d4 and project 64f290418a3e42ba962a70a5af666a9d. Resources: {'instances', 'cores', 'ram'} {{(pid=118624) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:37:30.076179 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-050ab70b-6b66-4445-b561-e820d1579600 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Going to run 1 instances... {{(pid=118624) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 18:37:30.078618 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-050ab70b-6b66-4445-b561-e820d1579600 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 094c4fb0-55c2-469b-bbf6-cdd696ba29d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e2555120-8576-4128-944f-40805aa95a9b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118624) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 18:37:30.203778 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-050ab70b-6b66-4445-b561-e820d1579600 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.738628 Jun 14 18:37:30.204441 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 548/1074] 10.222.0.78 () {60 vars in 1146 bytes} [Tue Jun 14 18:37:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 18:37:30.218003 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-2675e772-e0a2-4041-9eeb-a2e838c11fea tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:30.222603 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-2675e772-e0a2-4041-9eeb-a2e838c11fea tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 094c4fb0-55c2-469b-bbf6-cdd696ba29d0] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:30.283238 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-2675e772-e0a2-4041-9eeb-a2e838c11fea tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f183ac34806e46bca89a6c99a8cb62d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f290418a3e42ba962a70a5af666a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:30.290251 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-2675e772-e0a2-4041-9eeb-a2e838c11fea tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] 10.222.0.78 "GET /compute/v2.1/servers/094c4fb0-55c2-469b-bbf6-cdd696ba29d0" status: 200 len: 1219 microversion: 2.1 time: 0.079012 Jun 14 18:37:30.290889 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 527/1075] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:30 2022] GET /compute/v2.1/servers/094c4fb0-55c2-469b-bbf6-cdd696ba29d0 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:30.826347 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-62e82b37-d8a8-4699-8973-5dcbd7f61ccf tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:30.829734 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-62e82b37-d8a8-4699-8973-5dcbd7f61ccf tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] [instance: fc4001b7-e9c8-49b1-a97d-3fc4abde4baa] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:30.841028 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-62e82b37-d8a8-4699-8973-5dcbd7f61ccf tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:30.841263 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-62e82b37-d8a8-4699-8973-5dcbd7f61ccf tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:30.842081 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-62e82b37-d8a8-4699-8973-5dcbd7f61ccf tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:30.842517 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-62e82b37-d8a8-4699-8973-5dcbd7f61ccf tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:31.081059 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-62e82b37-d8a8-4699-8973-5dcbd7f61ccf tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcebcd9a9d1e40089ded0c963a2ac1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dffb25bc1545c1aef7d52265daadc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:31.089080 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-62e82b37-d8a8-4699-8973-5dcbd7f61ccf tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] 10.222.0.78 "GET /compute/v2.1/servers/fc4001b7-e9c8-49b1-a97d-3fc4abde4baa" status: 200 len: 1314 microversion: 2.1 time: 0.271711 Jun 14 18:37:31.089818 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 549/1076] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:30 2022] GET /compute/v2.1/servers/fc4001b7-e9c8-49b1-a97d-3fc4abde4baa => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:31.307894 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-38dbb2b3-b9c7-4129-8251-73e1da0a8dd2 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:31.308470 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-38dbb2b3-b9c7-4129-8251-73e1da0a8dd2 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 094c4fb0-55c2-469b-bbf6-cdd696ba29d0] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:31.316991 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-38dbb2b3-b9c7-4129-8251-73e1da0a8dd2 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:31.317442 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-38dbb2b3-b9c7-4129-8251-73e1da0a8dd2 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:31.318224 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-38dbb2b3-b9c7-4129-8251-73e1da0a8dd2 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:31.318918 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-38dbb2b3-b9c7-4129-8251-73e1da0a8dd2 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:31.398474 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-38dbb2b3-b9c7-4129-8251-73e1da0a8dd2 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f183ac34806e46bca89a6c99a8cb62d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f290418a3e42ba962a70a5af666a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:31.413061 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-38dbb2b3-b9c7-4129-8251-73e1da0a8dd2 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] 10.222.0.78 "GET /compute/v2.1/servers/094c4fb0-55c2-469b-bbf6-cdd696ba29d0" status: 200 len: 1223 microversion: 2.1 time: 0.109313 Jun 14 18:37:31.413673 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 528/1077] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:31 2022] GET /compute/v2.1/servers/094c4fb0-55c2-469b-bbf6-cdd696ba29d0 => generated 1223 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:31.662519 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-a700146f-1fb4-4389-bab6-3eeaec52a61a req-0d979348-3bd5-494d-a108-9ef5d53e55f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc4001b7-e9c8-49b1-a97d-3fc4abde4baa", "tag": "db000776-f235-4bc5-87c6-fd9c05ac20a8"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:37:31.677051 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-a700146f-1fb4-4389-bab6-3eeaec52a61a req-0d979348-3bd5-494d-a108-9ef5d53e55f6 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:31.678501 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-a700146f-1fb4-4389-bab6-3eeaec52a61a req-0d979348-3bd5-494d-a108-9ef5d53e55f6 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:31.692105 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-a700146f-1fb4-4389-bab6-3eeaec52a61a req-0d979348-3bd5-494d-a108-9ef5d53e55f6 service nova] Creating event network-changed:db000776-f235-4bc5-87c6-fd9c05ac20a8 for instance fc4001b7-e9c8-49b1-a97d-3fc4abde4baa on hv-cinder-84456 Jun 14 18:37:31.698294 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-a700146f-1fb4-4389-bab6-3eeaec52a61a req-0d979348-3bd5-494d-a108-9ef5d53e55f6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040058 Jun 14 18:37:31.698903 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 550/1078] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:37:32.106610 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-877fde5e-cd31-410a-b3d2-c54ce532be82 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:32.107332 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-877fde5e-cd31-410a-b3d2-c54ce532be82 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] [instance: fc4001b7-e9c8-49b1-a97d-3fc4abde4baa] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:32.113717 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-877fde5e-cd31-410a-b3d2-c54ce532be82 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:32.114159 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-877fde5e-cd31-410a-b3d2-c54ce532be82 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:32.115006 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-877fde5e-cd31-410a-b3d2-c54ce532be82 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:32.115353 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-877fde5e-cd31-410a-b3d2-c54ce532be82 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:32.268729 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-877fde5e-cd31-410a-b3d2-c54ce532be82 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcebcd9a9d1e40089ded0c963a2ac1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dffb25bc1545c1aef7d52265daadc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:32.283280 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-877fde5e-cd31-410a-b3d2-c54ce532be82 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] 10.222.0.78 "GET /compute/v2.1/servers/fc4001b7-e9c8-49b1-a97d-3fc4abde4baa" status: 200 len: 1314 microversion: 2.1 time: 0.180092 Jun 14 18:37:32.284348 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 529/1079] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:32 2022] GET /compute/v2.1/servers/fc4001b7-e9c8-49b1-a97d-3fc4abde4baa => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:32.431952 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-64aa8a71-a098-472b-aa76-51df0db67e9a tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:32.432807 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-64aa8a71-a098-472b-aa76-51df0db67e9a tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 094c4fb0-55c2-469b-bbf6-cdd696ba29d0] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:32.446271 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-64aa8a71-a098-472b-aa76-51df0db67e9a tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:32.446743 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-64aa8a71-a098-472b-aa76-51df0db67e9a tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:32.447552 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-64aa8a71-a098-472b-aa76-51df0db67e9a tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:32.448000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-64aa8a71-a098-472b-aa76-51df0db67e9a tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:32.540039 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-64aa8a71-a098-472b-aa76-51df0db67e9a tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f183ac34806e46bca89a6c99a8cb62d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f290418a3e42ba962a70a5af666a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:32.547870 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-64aa8a71-a098-472b-aa76-51df0db67e9a tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] 10.222.0.78 "GET /compute/v2.1/servers/094c4fb0-55c2-469b-bbf6-cdd696ba29d0" status: 200 len: 1279 microversion: 2.1 time: 0.120739 Jun 14 18:37:32.548886 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 551/1080] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:32 2022] GET /compute/v2.1/servers/094c4fb0-55c2-469b-bbf6-cdd696ba29d0 => generated 1279 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:33.301107 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-ffbbf558-89f3-40db-be43-c3e8db0b8758 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:33.301740 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-ffbbf558-89f3-40db-be43-c3e8db0b8758 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] [instance: fc4001b7-e9c8-49b1-a97d-3fc4abde4baa] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:33.308717 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ffbbf558-89f3-40db-be43-c3e8db0b8758 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:33.309163 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ffbbf558-89f3-40db-be43-c3e8db0b8758 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:33.310928 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ffbbf558-89f3-40db-be43-c3e8db0b8758 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:33.311384 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-ffbbf558-89f3-40db-be43-c3e8db0b8758 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:33.511366 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-ffbbf558-89f3-40db-be43-c3e8db0b8758 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcebcd9a9d1e40089ded0c963a2ac1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dffb25bc1545c1aef7d52265daadc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:33.519906 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-ffbbf558-89f3-40db-be43-c3e8db0b8758 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] 10.222.0.78 "GET /compute/v2.1/servers/fc4001b7-e9c8-49b1-a97d-3fc4abde4baa" status: 200 len: 1314 microversion: 2.1 time: 0.222795 Jun 14 18:37:33.520488 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 530/1081] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:33 2022] GET /compute/v2.1/servers/fc4001b7-e9c8-49b1-a97d-3fc4abde4baa => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:33.565778 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-6c2790d1-6613-44f8-b116-0ada257fc413 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:33.566397 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-6c2790d1-6613-44f8-b116-0ada257fc413 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 094c4fb0-55c2-469b-bbf6-cdd696ba29d0] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:33.572953 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6c2790d1-6613-44f8-b116-0ada257fc413 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:33.573647 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6c2790d1-6613-44f8-b116-0ada257fc413 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:33.574613 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6c2790d1-6613-44f8-b116-0ada257fc413 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:33.575110 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-6c2790d1-6613-44f8-b116-0ada257fc413 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:33.710018 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-6c2790d1-6613-44f8-b116-0ada257fc413 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f183ac34806e46bca89a6c99a8cb62d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f290418a3e42ba962a70a5af666a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:33.718122 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-6c2790d1-6613-44f8-b116-0ada257fc413 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] 10.222.0.78 "GET /compute/v2.1/servers/094c4fb0-55c2-469b-bbf6-cdd696ba29d0" status: 200 len: 1319 microversion: 2.1 time: 0.156036 Jun 14 18:37:33.718807 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 552/1082] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:33 2022] GET /compute/v2.1/servers/094c4fb0-55c2-469b-bbf6-cdd696ba29d0 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:37:34.218686 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-44a1c194-cbc8-46aa-82f3-460009e07c48 req-3ce66a3a-e1b4-44ed-b42c-6769d9d3aff9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "094c4fb0-55c2-469b-bbf6-cdd696ba29d0", "tag": "e1764ec3-2d3a-4526-a3a8-fa6815567096"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:37:34.226891 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-44a1c194-cbc8-46aa-82f3-460009e07c48 req-3ce66a3a-e1b4-44ed-b42c-6769d9d3aff9 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:34.227366 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-44a1c194-cbc8-46aa-82f3-460009e07c48 req-3ce66a3a-e1b4-44ed-b42c-6769d9d3aff9 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:34.239971 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-44a1c194-cbc8-46aa-82f3-460009e07c48 req-3ce66a3a-e1b4-44ed-b42c-6769d9d3aff9 service nova] Creating event network-changed:e1764ec3-2d3a-4526-a3a8-fa6815567096 for instance 094c4fb0-55c2-469b-bbf6-cdd696ba29d0 on hv-cinder-84456 Jun 14 18:37:34.245264 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-44a1c194-cbc8-46aa-82f3-460009e07c48 req-3ce66a3a-e1b4-44ed-b42c-6769d9d3aff9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031938 Jun 14 18:37:34.245875 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 531/1083] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:37:34.537845 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-443ce30c-a351-4373-ac23-246e973ea70a tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:34.538465 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-443ce30c-a351-4373-ac23-246e973ea70a tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] [instance: fc4001b7-e9c8-49b1-a97d-3fc4abde4baa] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:34.545124 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-443ce30c-a351-4373-ac23-246e973ea70a tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:34.545625 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-443ce30c-a351-4373-ac23-246e973ea70a tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:34.546431 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-443ce30c-a351-4373-ac23-246e973ea70a tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:34.546946 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-443ce30c-a351-4373-ac23-246e973ea70a tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:34.684193 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-443ce30c-a351-4373-ac23-246e973ea70a tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcebcd9a9d1e40089ded0c963a2ac1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dffb25bc1545c1aef7d52265daadc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:34.692753 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-443ce30c-a351-4373-ac23-246e973ea70a tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] 10.222.0.78 "GET /compute/v2.1/servers/fc4001b7-e9c8-49b1-a97d-3fc4abde4baa" status: 200 len: 1314 microversion: 2.1 time: 0.159222 Jun 14 18:37:34.693344 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 553/1084] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:34 2022] GET /compute/v2.1/servers/fc4001b7-e9c8-49b1-a97d-3fc4abde4baa => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:34.736760 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-4654e251-396b-428e-9c8f-8690094449cf tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:34.737364 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-4654e251-396b-428e-9c8f-8690094449cf tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 094c4fb0-55c2-469b-bbf6-cdd696ba29d0] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:34.744329 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4654e251-396b-428e-9c8f-8690094449cf tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:34.746829 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4654e251-396b-428e-9c8f-8690094449cf tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:34.746829 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4654e251-396b-428e-9c8f-8690094449cf tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:34.746829 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-4654e251-396b-428e-9c8f-8690094449cf tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:34.968478 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-4654e251-396b-428e-9c8f-8690094449cf tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f183ac34806e46bca89a6c99a8cb62d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f290418a3e42ba962a70a5af666a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:34.976240 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-4654e251-396b-428e-9c8f-8690094449cf tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] 10.222.0.78 "GET /compute/v2.1/servers/094c4fb0-55c2-469b-bbf6-cdd696ba29d0" status: 200 len: 1319 microversion: 2.1 time: 0.244367 Jun 14 18:37:34.976853 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 532/1085] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:34 2022] GET /compute/v2.1/servers/094c4fb0-55c2-469b-bbf6-cdd696ba29d0 => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:35.709193 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-feeec8c8-1e7e-4a72-b244-3a7c248e909d tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:35.709848 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-feeec8c8-1e7e-4a72-b244-3a7c248e909d tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] [instance: fc4001b7-e9c8-49b1-a97d-3fc4abde4baa] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:35.716860 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-feeec8c8-1e7e-4a72-b244-3a7c248e909d tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:35.717311 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-feeec8c8-1e7e-4a72-b244-3a7c248e909d tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:35.718117 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-feeec8c8-1e7e-4a72-b244-3a7c248e909d tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:35.718558 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-feeec8c8-1e7e-4a72-b244-3a7c248e909d tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:35.850890 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-feeec8c8-1e7e-4a72-b244-3a7c248e909d tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcebcd9a9d1e40089ded0c963a2ac1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dffb25bc1545c1aef7d52265daadc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:35.859225 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-feeec8c8-1e7e-4a72-b244-3a7c248e909d tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] 10.222.0.78 "GET /compute/v2.1/servers/fc4001b7-e9c8-49b1-a97d-3fc4abde4baa" status: 200 len: 1314 microversion: 2.1 time: 0.153845 Jun 14 18:37:35.859793 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 554/1086] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:35 2022] GET /compute/v2.1/servers/fc4001b7-e9c8-49b1-a97d-3fc4abde4baa => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:35.993508 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-a874072f-8a9d-492a-8365-23273e57548c tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:35.994132 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-a874072f-8a9d-492a-8365-23273e57548c tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 094c4fb0-55c2-469b-bbf6-cdd696ba29d0] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:36.001761 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a874072f-8a9d-492a-8365-23273e57548c tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:36.002218 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a874072f-8a9d-492a-8365-23273e57548c tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:36.003550 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a874072f-8a9d-492a-8365-23273e57548c tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:36.003550 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a874072f-8a9d-492a-8365-23273e57548c tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:36.144705 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-a874072f-8a9d-492a-8365-23273e57548c tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f183ac34806e46bca89a6c99a8cb62d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f290418a3e42ba962a70a5af666a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:36.145052 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-a874072f-8a9d-492a-8365-23273e57548c tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] 10.222.0.78 "GET /compute/v2.1/servers/094c4fb0-55c2-469b-bbf6-cdd696ba29d0" status: 200 len: 1319 microversion: 2.1 time: 0.155432 Jun 14 18:37:36.145624 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 533/1087] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:35 2022] GET /compute/v2.1/servers/094c4fb0-55c2-469b-bbf6-cdd696ba29d0 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:36.876914 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-3f9fc456-109e-4e89-af4f-481ab0d7b67a tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:36.877552 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-3f9fc456-109e-4e89-af4f-481ab0d7b67a tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] [instance: fc4001b7-e9c8-49b1-a97d-3fc4abde4baa] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:36.883981 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3f9fc456-109e-4e89-af4f-481ab0d7b67a tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:36.884423 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3f9fc456-109e-4e89-af4f-481ab0d7b67a tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:36.885180 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3f9fc456-109e-4e89-af4f-481ab0d7b67a tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:36.885640 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-3f9fc456-109e-4e89-af4f-481ab0d7b67a tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:37.016241 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-3f9fc456-109e-4e89-af4f-481ab0d7b67a tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcebcd9a9d1e40089ded0c963a2ac1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dffb25bc1545c1aef7d52265daadc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:37.024218 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-3f9fc456-109e-4e89-af4f-481ab0d7b67a tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] 10.222.0.78 "GET /compute/v2.1/servers/fc4001b7-e9c8-49b1-a97d-3fc4abde4baa" status: 200 len: 1314 microversion: 2.1 time: 0.151930 Jun 14 18:37:37.024835 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 555/1088] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:36 2022] GET /compute/v2.1/servers/fc4001b7-e9c8-49b1-a97d-3fc4abde4baa => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:37.163208 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-461d26a0-fef8-45b4-88d6-f644af6e824e tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:37.163949 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-461d26a0-fef8-45b4-88d6-f644af6e824e tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 094c4fb0-55c2-469b-bbf6-cdd696ba29d0] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:37.166206 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell0:SELECT=2 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:37:37.172404 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-461d26a0-fef8-45b4-88d6-f644af6e824e tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:37.175242 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-461d26a0-fef8-45b4-88d6-f644af6e824e tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:37.175242 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-461d26a0-fef8-45b4-88d6-f644af6e824e tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:37.175242 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-461d26a0-fef8-45b4-88d6-f644af6e824e tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:37.284769 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-f80952f8-52dd-48eb-868e-4dea5d0c4572 req-c45b71c3-56e8-4d14-8c7c-65f8c7a4adac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc4001b7-e9c8-49b1-a97d-3fc4abde4baa", "name": "network-vif-plugged", "status": "completed", "tag": "db000776-f235-4bc5-87c6-fd9c05ac20a8"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:37:37.292959 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-f80952f8-52dd-48eb-868e-4dea5d0c4572 req-c45b71c3-56e8-4d14-8c7c-65f8c7a4adac service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:37.293801 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-f80952f8-52dd-48eb-868e-4dea5d0c4572 req-c45b71c3-56e8-4d14-8c7c-65f8c7a4adac service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:37.308748 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-f80952f8-52dd-48eb-868e-4dea5d0c4572 req-c45b71c3-56e8-4d14-8c7c-65f8c7a4adac service nova] Creating event network-vif-plugged:db000776-f235-4bc5-87c6-fd9c05ac20a8 for instance fc4001b7-e9c8-49b1-a97d-3fc4abde4baa on hv-cinder-84456 Jun 14 18:37:37.314755 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-f80952f8-52dd-48eb-868e-4dea5d0c4572 req-c45b71c3-56e8-4d14-8c7c-65f8c7a4adac service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033844 Jun 14 18:37:37.315362 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 556/1089] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:37:37.331821 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-461d26a0-fef8-45b4-88d6-f644af6e824e tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f183ac34806e46bca89a6c99a8cb62d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f290418a3e42ba962a70a5af666a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:37.340554 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-461d26a0-fef8-45b4-88d6-f644af6e824e tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] 10.222.0.78 "GET /compute/v2.1/servers/094c4fb0-55c2-469b-bbf6-cdd696ba29d0" status: 200 len: 1319 microversion: 2.1 time: 0.181225 Jun 14 18:37:37.341937 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 534/1090] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:37 2022] GET /compute/v2.1/servers/094c4fb0-55c2-469b-bbf6-cdd696ba29d0 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:38.043780 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-eac46f2c-61ae-491b-b220-fbff876cf537 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:38.045053 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-eac46f2c-61ae-491b-b220-fbff876cf537 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] [instance: fc4001b7-e9c8-49b1-a97d-3fc4abde4baa] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:38.051389 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-eac46f2c-61ae-491b-b220-fbff876cf537 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:38.051840 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-eac46f2c-61ae-491b-b220-fbff876cf537 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:38.052658 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-eac46f2c-61ae-491b-b220-fbff876cf537 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:38.053101 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-eac46f2c-61ae-491b-b220-fbff876cf537 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:38.192873 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-eac46f2c-61ae-491b-b220-fbff876cf537 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcebcd9a9d1e40089ded0c963a2ac1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dffb25bc1545c1aef7d52265daadc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:38.202138 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-eac46f2c-61ae-491b-b220-fbff876cf537 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] 10.222.0.78 "GET /compute/v2.1/servers/fc4001b7-e9c8-49b1-a97d-3fc4abde4baa" status: 200 len: 1314 microversion: 2.1 time: 0.162970 Jun 14 18:37:38.202724 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 557/1091] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:38 2022] GET /compute/v2.1/servers/fc4001b7-e9c8-49b1-a97d-3fc4abde4baa => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:38.359122 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-1e5efc16-c9d9-487a-8a67-2c57a4f901f9 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:38.359743 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-1e5efc16-c9d9-487a-8a67-2c57a4f901f9 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 094c4fb0-55c2-469b-bbf6-cdd696ba29d0] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:38.366577 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1e5efc16-c9d9-487a-8a67-2c57a4f901f9 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:38.367029 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1e5efc16-c9d9-487a-8a67-2c57a4f901f9 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:38.367803 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1e5efc16-c9d9-487a-8a67-2c57a4f901f9 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:38.368242 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-1e5efc16-c9d9-487a-8a67-2c57a4f901f9 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:38.510987 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-1e5efc16-c9d9-487a-8a67-2c57a4f901f9 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f183ac34806e46bca89a6c99a8cb62d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f290418a3e42ba962a70a5af666a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:38.519315 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-1e5efc16-c9d9-487a-8a67-2c57a4f901f9 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] 10.222.0.78 "GET /compute/v2.1/servers/094c4fb0-55c2-469b-bbf6-cdd696ba29d0" status: 200 len: 1319 microversion: 2.1 time: 0.164523 Jun 14 18:37:38.519894 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 535/1092] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:38 2022] GET /compute/v2.1/servers/094c4fb0-55c2-469b-bbf6-cdd696ba29d0 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:39.219869 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-113ff6e1-b481-4cc6-ae90-b33db77d840b tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:39.220881 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-113ff6e1-b481-4cc6-ae90-b33db77d840b tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] [instance: fc4001b7-e9c8-49b1-a97d-3fc4abde4baa] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:39.227446 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-113ff6e1-b481-4cc6-ae90-b33db77d840b tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:39.227899 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-113ff6e1-b481-4cc6-ae90-b33db77d840b tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:39.228676 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-113ff6e1-b481-4cc6-ae90-b33db77d840b tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:39.229118 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-113ff6e1-b481-4cc6-ae90-b33db77d840b tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:39.334909 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-b734797d-b76d-4213-b7b0-942c080df477 req-380ecabd-bb07-43de-a419-7f147ed99dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "094c4fb0-55c2-469b-bbf6-cdd696ba29d0", "name": "network-vif-plugged", "status": "completed", "tag": "e1764ec3-2d3a-4526-a3a8-fa6815567096"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:37:39.343120 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-b734797d-b76d-4213-b7b0-942c080df477 req-380ecabd-bb07-43de-a419-7f147ed99dc8 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:39.343571 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-b734797d-b76d-4213-b7b0-942c080df477 req-380ecabd-bb07-43de-a419-7f147ed99dc8 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:39.357863 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-b734797d-b76d-4213-b7b0-942c080df477 req-380ecabd-bb07-43de-a419-7f147ed99dc8 service nova] Creating event network-vif-plugged:e1764ec3-2d3a-4526-a3a8-fa6815567096 for instance 094c4fb0-55c2-469b-bbf6-cdd696ba29d0 on hv-cinder-84456 Jun 14 18:37:39.363189 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-b734797d-b76d-4213-b7b0-942c080df477 req-380ecabd-bb07-43de-a419-7f147ed99dc8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034143 Jun 14 18:37:39.365739 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 536/1093] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:37:39.368810 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-113ff6e1-b481-4cc6-ae90-b33db77d840b tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcebcd9a9d1e40089ded0c963a2ac1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dffb25bc1545c1aef7d52265daadc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:39.376709 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-113ff6e1-b481-4cc6-ae90-b33db77d840b tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] 10.222.0.78 "GET /compute/v2.1/servers/fc4001b7-e9c8-49b1-a97d-3fc4abde4baa" status: 200 len: 1464 microversion: 2.1 time: 0.161295 Jun 14 18:37:39.377288 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 558/1094] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:39 2022] GET /compute/v2.1/servers/fc4001b7-e9c8-49b1-a97d-3fc4abde4baa => generated 1464 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:39.421016 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-47cea58c-8f9e-4527-9254-038fd54d35c7 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:39.421706 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-47cea58c-8f9e-4527-9254-038fd54d35c7 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] [instance: fc4001b7-e9c8-49b1-a97d-3fc4abde4baa] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:39.427871 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-47cea58c-8f9e-4527-9254-038fd54d35c7 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:39.428318 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-47cea58c-8f9e-4527-9254-038fd54d35c7 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:39.429077 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-47cea58c-8f9e-4527-9254-038fd54d35c7 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:39.429531 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-47cea58c-8f9e-4527-9254-038fd54d35c7 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:39.457186 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-47cea58c-8f9e-4527-9254-038fd54d35c7 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] [instance: fc4001b7-e9c8-49b1-a97d-3fc4abde4baa] Going to try to terminate instance {{(pid=118623) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:37:39.537084 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-73c07253-d381-4a16-b8e3-cbf6e7708d4d tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:39.537730 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-73c07253-d381-4a16-b8e3-cbf6e7708d4d tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 094c4fb0-55c2-469b-bbf6-cdd696ba29d0] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:39.543892 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-73c07253-d381-4a16-b8e3-cbf6e7708d4d tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:39.544604 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-73c07253-d381-4a16-b8e3-cbf6e7708d4d tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:39.545388 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-73c07253-d381-4a16-b8e3-cbf6e7708d4d tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:39.545860 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-73c07253-d381-4a16-b8e3-cbf6e7708d4d tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:39.687526 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-73c07253-d381-4a16-b8e3-cbf6e7708d4d tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f183ac34806e46bca89a6c99a8cb62d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f290418a3e42ba962a70a5af666a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:39.695955 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-73c07253-d381-4a16-b8e3-cbf6e7708d4d tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] 10.222.0.78 "GET /compute/v2.1/servers/094c4fb0-55c2-469b-bbf6-cdd696ba29d0" status: 200 len: 1319 microversion: 2.1 time: 0.162832 Jun 14 18:37:39.707001 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 559/1095] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:39 2022] GET /compute/v2.1/servers/094c4fb0-55c2-469b-bbf6-cdd696ba29d0 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:37:39.817717 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-47cea58c-8f9e-4527-9254-038fd54d35c7 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] 10.222.0.78 "DELETE /compute/v2.1/servers/fc4001b7-e9c8-49b1-a97d-3fc4abde4baa" status: 204 len: 0 microversion: 2.1 time: 0.401227 Jun 14 18:37:39.818360 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 537/1096] 10.222.0.78 () {58 vars in 1238 bytes} [Tue Jun 14 18:37:39 2022] DELETE /compute/v2.1/servers/fc4001b7-e9c8-49b1-a97d-3fc4abde4baa => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 18:37:39.826762 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-86e29130-0c67-436a-9013-dff9416d54ad tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:39.827386 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-86e29130-0c67-436a-9013-dff9416d54ad tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] [instance: fc4001b7-e9c8-49b1-a97d-3fc4abde4baa] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:39.833757 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-86e29130-0c67-436a-9013-dff9416d54ad tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:39.834201 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-86e29130-0c67-436a-9013-dff9416d54ad tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:39.834989 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-86e29130-0c67-436a-9013-dff9416d54ad tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:39.835426 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-86e29130-0c67-436a-9013-dff9416d54ad tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:39.971905 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-86e29130-0c67-436a-9013-dff9416d54ad tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcebcd9a9d1e40089ded0c963a2ac1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dffb25bc1545c1aef7d52265daadc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:39.979468 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-86e29130-0c67-436a-9013-dff9416d54ad tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] 10.222.0.78 "GET /compute/v2.1/servers/fc4001b7-e9c8-49b1-a97d-3fc4abde4baa" status: 200 len: 1470 microversion: 2.1 time: 0.156715 Jun 14 18:37:39.980031 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 560/1097] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:39 2022] GET /compute/v2.1/servers/fc4001b7-e9c8-49b1-a97d-3fc4abde4baa => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:40.714835 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-9b109b19-7c11-4896-b67a-4f25b3b45346 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:40.715521 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-9b109b19-7c11-4896-b67a-4f25b3b45346 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 094c4fb0-55c2-469b-bbf6-cdd696ba29d0] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:40.718235 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell0:SELECT=8 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:37:40.723548 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9b109b19-7c11-4896-b67a-4f25b3b45346 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:40.723987 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9b109b19-7c11-4896-b67a-4f25b3b45346 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:40.724802 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9b109b19-7c11-4896-b67a-4f25b3b45346 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:40.725263 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9b109b19-7c11-4896-b67a-4f25b3b45346 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:40.856782 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-9b109b19-7c11-4896-b67a-4f25b3b45346 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f183ac34806e46bca89a6c99a8cb62d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f290418a3e42ba962a70a5af666a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:40.864593 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-9b109b19-7c11-4896-b67a-4f25b3b45346 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] 10.222.0.78 "GET /compute/v2.1/servers/094c4fb0-55c2-469b-bbf6-cdd696ba29d0" status: 200 len: 1319 microversion: 2.1 time: 0.154094 Jun 14 18:37:40.865164 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 538/1098] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:40 2022] GET /compute/v2.1/servers/094c4fb0-55c2-469b-bbf6-cdd696ba29d0 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:40.999173 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-f87cd416-dda8-47da-b3b3-357a5c9cc32a tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:40.999762 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-f87cd416-dda8-47da-b3b3-357a5c9cc32a tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] [instance: fc4001b7-e9c8-49b1-a97d-3fc4abde4baa] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:41.001857 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell0:SELECT=2 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:37:41.002533 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell0:SELECT=10 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:37:41.008063 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f87cd416-dda8-47da-b3b3-357a5c9cc32a tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:41.008509 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f87cd416-dda8-47da-b3b3-357a5c9cc32a tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:41.009283 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f87cd416-dda8-47da-b3b3-357a5c9cc32a tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:41.009747 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-f87cd416-dda8-47da-b3b3-357a5c9cc32a tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:41.157683 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-f87cd416-dda8-47da-b3b3-357a5c9cc32a tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcebcd9a9d1e40089ded0c963a2ac1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dffb25bc1545c1aef7d52265daadc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:41.165368 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-f87cd416-dda8-47da-b3b3-357a5c9cc32a tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] 10.222.0.78 "GET /compute/v2.1/servers/fc4001b7-e9c8-49b1-a97d-3fc4abde4baa" status: 200 len: 1470 microversion: 2.1 time: 0.171139 Jun 14 18:37:41.165983 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 561/1099] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:40 2022] GET /compute/v2.1/servers/fc4001b7-e9c8-49b1-a97d-3fc4abde4baa => generated 1470 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:41.881821 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-54727cc4-0c01-4b4d-b55b-ae622e281c1d tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:41.882379 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-54727cc4-0c01-4b4d-b55b-ae622e281c1d tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 094c4fb0-55c2-469b-bbf6-cdd696ba29d0] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:41.888889 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-54727cc4-0c01-4b4d-b55b-ae622e281c1d tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:41.889344 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-54727cc4-0c01-4b4d-b55b-ae622e281c1d tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:41.890159 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-54727cc4-0c01-4b4d-b55b-ae622e281c1d tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:41.890588 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-54727cc4-0c01-4b4d-b55b-ae622e281c1d tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:42.066595 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-54727cc4-0c01-4b4d-b55b-ae622e281c1d tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f183ac34806e46bca89a6c99a8cb62d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f290418a3e42ba962a70a5af666a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:42.074990 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-54727cc4-0c01-4b4d-b55b-ae622e281c1d tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] 10.222.0.78 "GET /compute/v2.1/servers/094c4fb0-55c2-469b-bbf6-cdd696ba29d0" status: 200 len: 1319 microversion: 2.1 time: 0.197066 Jun 14 18:37:42.083618 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 539/1100] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:41 2022] GET /compute/v2.1/servers/094c4fb0-55c2-469b-bbf6-cdd696ba29d0 => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:42.182557 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-10e4b795-7d63-45d0-8fb4-d45292e1438f tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:42.183381 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-10e4b795-7d63-45d0-8fb4-d45292e1438f tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] [instance: fc4001b7-e9c8-49b1-a97d-3fc4abde4baa] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:42.190605 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-10e4b795-7d63-45d0-8fb4-d45292e1438f tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:42.191059 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-10e4b795-7d63-45d0-8fb4-d45292e1438f tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:42.191853 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-10e4b795-7d63-45d0-8fb4-d45292e1438f tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:42.192574 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-10e4b795-7d63-45d0-8fb4-d45292e1438f tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:42.337012 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-10e4b795-7d63-45d0-8fb4-d45292e1438f tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcebcd9a9d1e40089ded0c963a2ac1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dffb25bc1545c1aef7d52265daadc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:42.345754 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-10e4b795-7d63-45d0-8fb4-d45292e1438f tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] 10.222.0.78 "GET /compute/v2.1/servers/fc4001b7-e9c8-49b1-a97d-3fc4abde4baa" status: 200 len: 1470 microversion: 2.1 time: 0.167176 Jun 14 18:37:42.346280 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 562/1101] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:42 2022] GET /compute/v2.1/servers/fc4001b7-e9c8-49b1-a97d-3fc4abde4baa => generated 1470 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:42.513214 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-d8b2ad49-6990-4d1b-9b38-9e69a196b859 req-69d4d5ea-b40a-4d34-8fdf-23313575c56d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc4001b7-e9c8-49b1-a97d-3fc4abde4baa", "name": "network-vif-deleted", "tag": "db000776-f235-4bc5-87c6-fd9c05ac20a8"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:37:42.522106 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-d8b2ad49-6990-4d1b-9b38-9e69a196b859 req-69d4d5ea-b40a-4d34-8fdf-23313575c56d service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:42.522546 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-d8b2ad49-6990-4d1b-9b38-9e69a196b859 req-69d4d5ea-b40a-4d34-8fdf-23313575c56d service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:42.534902 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-d8b2ad49-6990-4d1b-9b38-9e69a196b859 req-69d4d5ea-b40a-4d34-8fdf-23313575c56d service nova] Creating event network-vif-deleted:db000776-f235-4bc5-87c6-fd9c05ac20a8 for instance fc4001b7-e9c8-49b1-a97d-3fc4abde4baa on hv-cinder-84456 Jun 14 18:37:42.540203 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-d8b2ad49-6990-4d1b-9b38-9e69a196b859 req-69d4d5ea-b40a-4d34-8fdf-23313575c56d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033322 Jun 14 18:37:42.541009 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 540/1102] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:37:43.093309 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-5346718c-f930-41f7-997a-8485e0884063 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:43.094052 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-5346718c-f930-41f7-997a-8485e0884063 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 094c4fb0-55c2-469b-bbf6-cdd696ba29d0] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:43.100215 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5346718c-f930-41f7-997a-8485e0884063 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:43.100660 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5346718c-f930-41f7-997a-8485e0884063 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:43.101425 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5346718c-f930-41f7-997a-8485e0884063 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:43.101880 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-5346718c-f930-41f7-997a-8485e0884063 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:43.238956 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-5346718c-f930-41f7-997a-8485e0884063 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f183ac34806e46bca89a6c99a8cb62d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f290418a3e42ba962a70a5af666a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:43.247338 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-5346718c-f930-41f7-997a-8485e0884063 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] 10.222.0.78 "GET /compute/v2.1/servers/094c4fb0-55c2-469b-bbf6-cdd696ba29d0" status: 200 len: 1508 microversion: 2.1 time: 0.157969 Jun 14 18:37:43.247902 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 563/1103] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:43 2022] GET /compute/v2.1/servers/094c4fb0-55c2-469b-bbf6-cdd696ba29d0 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:37:43.264827 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-18ea82d2-267c-44f2-b68c-77e95b22637c tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83270ced-6b08-4e55-b9c9-5a0d75965529", "device": "/dev/sdb"}} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:37:43.266068 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-18ea82d2-267c-44f2-b68c-77e95b22637c tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 094c4fb0-55c2-469b-bbf6-cdd696ba29d0] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:43.272529 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-18ea82d2-267c-44f2-b68c-77e95b22637c tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:43.272979 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-18ea82d2-267c-44f2-b68c-77e95b22637c tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:43.273792 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-18ea82d2-267c-44f2-b68c-77e95b22637c tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:43.274238 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-18ea82d2-267c-44f2-b68c-77e95b22637c tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:43.364143 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-83488b90-4191-4010-ad11-726c4ddab299 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:43.364766 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-83488b90-4191-4010-ad11-726c4ddab299 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] [instance: fc4001b7-e9c8-49b1-a97d-3fc4abde4baa] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:43.371285 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-83488b90-4191-4010-ad11-726c4ddab299 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:43.371736 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-83488b90-4191-4010-ad11-726c4ddab299 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:43.372527 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-83488b90-4191-4010-ad11-726c4ddab299 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:43.372960 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-83488b90-4191-4010-ad11-726c4ddab299 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:43.411270 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-83488b90-4191-4010-ad11-726c4ddab299 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:43.411745 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-83488b90-4191-4010-ad11-726c4ddab299 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:43.412235 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.objects.instance [None req-83488b90-4191-4010-ad11-726c4ddab299 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lazy-loading 'fault' on Instance uuid fc4001b7-e9c8-49b1-a97d-3fc4abde4baa {{(pid=118624) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:37:43.455626 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-83488b90-4191-4010-ad11-726c4ddab299 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcebcd9a9d1e40089ded0c963a2ac1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02dffb25bc1545c1aef7d52265daadc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:37:43.469264 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-83488b90-4191-4010-ad11-726c4ddab299 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] 10.222.0.78 "GET /compute/v2.1/servers/fc4001b7-e9c8-49b1-a97d-3fc4abde4baa" status: 200 len: 1304 microversion: 2.1 time: 0.108512 Jun 14 18:37:43.470388 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 564/1104] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:43 2022] GET /compute/v2.1/servers/fc4001b7-e9c8-49b1-a97d-3fc4abde4baa => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:37:43.867691 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:37:44.113651 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-18ea82d2-267c-44f2-b68c-77e95b22637c tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] 10.222.0.78 "POST /compute/v2.1/servers/094c4fb0-55c2-469b-bbf6-cdd696ba29d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.853025 Jun 14 18:37:44.114177 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 541/1105] 10.222.0.78 () {60 vars in 1322 bytes} [Tue Jun 14 18:37:43 2022] POST /compute/v2.1/servers/094c4fb0-55c2-469b-bbf6-cdd696ba29d0/os-volume_attachments => generated 194 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:37:44.488370 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-bf236e9d-fbfb-4afe-a054-cba790d43347 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:37:44.489062 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-bf236e9d-fbfb-4afe-a054-cba790d43347 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] [instance: fc4001b7-e9c8-49b1-a97d-3fc4abde4baa] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:37:44.497132 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-bf236e9d-fbfb-4afe-a054-cba790d43347 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:44.497975 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-bf236e9d-fbfb-4afe-a054-cba790d43347 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:44.500358 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-bf236e9d-fbfb-4afe-a054-cba790d43347 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:37:44.501156 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-bf236e9d-fbfb-4afe-a054-cba790d43347 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:37:44.508918 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell1:SELECT=100 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:37:44.528135 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.wsgi [None req-bf236e9d-fbfb-4afe-a054-cba790d43347 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] HTTP exception thrown: Instance fc4001b7-e9c8-49b1-a97d-3fc4abde4baa could not be found. Jun 14 18:37:44.530326 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-bf236e9d-fbfb-4afe-a054-cba790d43347 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Request method failure captured: Jun 14 18:37:44.530326 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: request: GET /compute/v2.1/servers/fc4001b7-e9c8-49b1-a97d-3fc4abde4baa HTTP/1.1 Jun 14 18:37:44.530326 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept: application/json Jun 14 18:37:44.530326 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept-Encoding: identity Jun 14 18:37:44.530326 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Connection: close Jun 14 18:37:44.530326 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Length: 0 Jun 14 18:37:44.530326 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Type: application/json Jun 14 18:37:44.530326 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Host: 10.222.0.78 Jun 14 18:37:44.530326 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Openstack-System-Scope: None Jun 14 18:37:44.530326 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: User-Agent: python-urllib3/1.26.9 Jun 14 18:37:44.530326 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Auth-Token: gAAAAABiqNVihMFlNaKPBzMFJcUwaC65tn9jp2IseSzFd9_bUJYQvfQhQmEHJe-4UsUDFuGTpNSYlUlLOaodc3AQhV7FUNZ5rGELYrfnjfNw-3gkZXXcrMsQa7qk99XQF39OjMv2BguFvMFb-JrWxYJc9nK-GqLpM46gTRYTROqFRHkZrh6icH0 Jun 14 18:37:44.530326 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Id: None Jun 14 18:37:44.530326 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Name: None Jun 14 18:37:44.530326 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Identity-Status: Confirmed Jun 14 18:37:44.530326 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Is-Admin-Project: True Jun 14 18:37:44.530326 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Id: default Jun 14 18:37:44.530326 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Name: Default Jun 14 18:37:44.530326 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Id: 02dffb25bc1545c1aef7d52265daadc2 Jun 14 18:37:44.530326 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Name: tempest-VolumesNegativeTest-1524529674 Jun 14 18:37:44.530326 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Role: reader,member Jun 14 18:37:44.530326 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Roles: reader,member Jun 14 18:37:44.532054 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_02dffb25bc1545c1aef7d52265daadc2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/02dffb25bc1545c1aef7d52265daadc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/02dffb25bc1545c1aef7d52265daadc2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/02dffb25bc1545c1aef7d52265daadc2"}]}] Jun 14 18:37:44.532054 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant: tempest-VolumesNegativeTest-1524529674 Jun 14 18:37:44.532054 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Id: 02dffb25bc1545c1aef7d52265daadc2 Jun 14 18:37:44.532054 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Name: tempest-VolumesNegativeTest-1524529674 Jun 14 18:37:44.532054 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User: tempest-VolumesNegativeTest-1524529674-project Jun 14 18:37:44.532054 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Id: default Jun 14 18:37:44.532054 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Name: Default Jun 14 18:37:44.532054 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Id: bcebcd9a9d1e40089ded0c963a2ac1b4 Jun 14 18:37:44.532054 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Name: tempest-VolumesNegativeTest-1524529674-project Jun 14 18:37:44.532054 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: method: > Jun 14 18:37:44.532054 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: exception: Instance fc4001b7-e9c8-49b1-a97d-3fc4abde4baa could not be found. Jun 14 18:37:44.532054 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: action_args: {'id': 'fc4001b7-e9c8-49b1-a97d-3fc4abde4baa'} Jun 14 18:37:44.533094 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:37:44.533094 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:37:44.533094 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:37:44.533094 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:37:44.533094 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:37:44.533094 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:37:44.533094 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:37:44.533094 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:37:44.533094 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:37:44.533094 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:37:44.533094 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc4001b7-e9c8-49b1-a97d-3fc4abde4baa could not be found. Jun 14 18:37:44.533094 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:37:44.533094 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:37:44.533094 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:37:44.533094 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:37:44.533094 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:37:44.533094 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:37:44.533094 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:37:44.533094 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:37:44.533094 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:37:44.534914 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:37:44.534914 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:37:44.534914 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:37:44.534914 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:37:44.534914 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:37:44.534914 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:37:44.534914 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:37:44.534914 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc4001b7-e9c8-49b1-a97d-3fc4abde4baa could not be found. Jun 14 18:37:44.534914 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:37:44.534914 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:37:44.534914 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:37:44.534914 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:37:44.534914 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:37:44.534914 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:37:44.534914 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:37:44.534914 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:37:44.534914 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc4001b7-e9c8-49b1-a97d-3fc4abde4baa could not be found. Jun 14 18:37:44.534914 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:37:44.536378 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-bf236e9d-fbfb-4afe-a054-cba790d43347 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] Returning 404 to user: Instance fc4001b7-e9c8-49b1-a97d-3fc4abde4baa could not be found. {{(pid=118624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:37:44.536378 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-bf236e9d-fbfb-4afe-a054-cba790d43347 tempest-VolumesNegativeTest-1524529674 tempest-VolumesNegativeTest-1524529674-project] 10.222.0.78 "GET /compute/v2.1/servers/fc4001b7-e9c8-49b1-a97d-3fc4abde4baa" status: 404 len: 111 microversion: 2.1 time: 0.047502 Jun 14 18:37:44.536378 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 565/1106] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:37:44 2022] GET /compute/v2.1/servers/fc4001b7-e9c8-49b1-a97d-3fc4abde4baa => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 14 18:38:04.161142 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-b116a27c-5e02-4833-994c-79ed56a3a76e tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:38:04.161834 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-b116a27c-5e02-4833-994c-79ed56a3a76e tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 094c4fb0-55c2-469b-bbf6-cdd696ba29d0] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:38:04.164899 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:38:04.170187 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b116a27c-5e02-4833-994c-79ed56a3a76e tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:38:04.170679 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b116a27c-5e02-4833-994c-79ed56a3a76e tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:38:04.171529 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b116a27c-5e02-4833-994c-79ed56a3a76e tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:38:04.172007 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-b116a27c-5e02-4833-994c-79ed56a3a76e tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:38:04.254367 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.objects.instance [None req-b116a27c-5e02-4833-994c-79ed56a3a76e tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lazy-loading 'services' on Instance uuid 094c4fb0-55c2-469b-bbf6-cdd696ba29d0 {{(pid=118623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:38:04.473351 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-b116a27c-5e02-4833-994c-79ed56a3a76e tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] 10.222.0.78 "DELETE /compute/v2.1/servers/094c4fb0-55c2-469b-bbf6-cdd696ba29d0/os-volume_attachments/83270ced-6b08-4e55-b9c9-5a0d75965529" status: 202 len: 0 microversion: 2.1 time: 0.316431 Jun 14 18:38:04.473979 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 542/1107] 10.222.0.78 () {58 vars in 1415 bytes} [Tue Jun 14 18:38:04 2022] DELETE /compute/v2.1/servers/094c4fb0-55c2-469b-bbf6-cdd696ba29d0/os-volume_attachments/83270ced-6b08-4e55-b9c9-5a0d75965529 => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:38:05.584698 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-84d75aaf-7e14-4552-875f-7acd901fc985 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:38:05.587532 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-84d75aaf-7e14-4552-875f-7acd901fc985 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 094c4fb0-55c2-469b-bbf6-cdd696ba29d0] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:38:05.587898 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:38:05.592903 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-84d75aaf-7e14-4552-875f-7acd901fc985 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:38:05.593359 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-84d75aaf-7e14-4552-875f-7acd901fc985 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:38:05.594165 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-84d75aaf-7e14-4552-875f-7acd901fc985 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:38:05.594606 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-84d75aaf-7e14-4552-875f-7acd901fc985 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:38:05.619338 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-84d75aaf-7e14-4552-875f-7acd901fc985 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 094c4fb0-55c2-469b-bbf6-cdd696ba29d0] Going to try to terminate instance {{(pid=118624) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:38:05.907738 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-84d75aaf-7e14-4552-875f-7acd901fc985 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] 10.222.0.78 "DELETE /compute/v2.1/servers/094c4fb0-55c2-469b-bbf6-cdd696ba29d0" status: 204 len: 0 microversion: 2.1 time: 0.327516 Jun 14 18:38:05.908328 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 566/1108] 10.222.0.78 () {58 vars in 1238 bytes} [Tue Jun 14 18:38:05 2022] DELETE /compute/v2.1/servers/094c4fb0-55c2-469b-bbf6-cdd696ba29d0 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 18:38:05.918722 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-9d5bc916-ef29-46ab-bc6a-b8e0a75f4c70 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:38:05.919495 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-9d5bc916-ef29-46ab-bc6a-b8e0a75f4c70 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 094c4fb0-55c2-469b-bbf6-cdd696ba29d0] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:38:05.927087 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9d5bc916-ef29-46ab-bc6a-b8e0a75f4c70 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:38:05.927530 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9d5bc916-ef29-46ab-bc6a-b8e0a75f4c70 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:38:05.928426 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9d5bc916-ef29-46ab-bc6a-b8e0a75f4c70 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:38:05.928993 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-9d5bc916-ef29-46ab-bc6a-b8e0a75f4c70 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:38:06.059985 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-9d5bc916-ef29-46ab-bc6a-b8e0a75f4c70 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f183ac34806e46bca89a6c99a8cb62d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f290418a3e42ba962a70a5af666a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:38:06.068370 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-9d5bc916-ef29-46ab-bc6a-b8e0a75f4c70 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] 10.222.0.78 "GET /compute/v2.1/servers/094c4fb0-55c2-469b-bbf6-cdd696ba29d0" status: 200 len: 1514 microversion: 2.1 time: 0.154945 Jun 14 18:38:06.068936 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 543/1109] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:38:05 2022] GET /compute/v2.1/servers/094c4fb0-55c2-469b-bbf6-cdd696ba29d0 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:38:07.086564 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-866152af-d7f4-4051-8f37-bd081c45d9e3 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:38:07.087262 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-866152af-d7f4-4051-8f37-bd081c45d9e3 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 094c4fb0-55c2-469b-bbf6-cdd696ba29d0] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:38:07.093881 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-866152af-d7f4-4051-8f37-bd081c45d9e3 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:38:07.094328 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-866152af-d7f4-4051-8f37-bd081c45d9e3 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:38:07.095089 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-866152af-d7f4-4051-8f37-bd081c45d9e3 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:38:07.095524 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-866152af-d7f4-4051-8f37-bd081c45d9e3 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:38:07.226755 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-866152af-d7f4-4051-8f37-bd081c45d9e3 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f183ac34806e46bca89a6c99a8cb62d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f290418a3e42ba962a70a5af666a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:38:07.234180 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-866152af-d7f4-4051-8f37-bd081c45d9e3 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] 10.222.0.78 "GET /compute/v2.1/servers/094c4fb0-55c2-469b-bbf6-cdd696ba29d0" status: 200 len: 1514 microversion: 2.1 time: 0.151999 Jun 14 18:38:07.234742 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 567/1110] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:38:07 2022] GET /compute/v2.1/servers/094c4fb0-55c2-469b-bbf6-cdd696ba29d0 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:38:08.239127 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-be677032-1784-41ff-a78a-70a258fbf2e4 req-90927a1c-ca3e-4944-84c4-f4f8d07841a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "094c4fb0-55c2-469b-bbf6-cdd696ba29d0", "name": "network-vif-deleted", "tag": "e1764ec3-2d3a-4526-a3a8-fa6815567096"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:38:08.248277 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-be677032-1784-41ff-a78a-70a258fbf2e4 req-90927a1c-ca3e-4944-84c4-f4f8d07841a4 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:38:08.248875 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-be677032-1784-41ff-a78a-70a258fbf2e4 req-90927a1c-ca3e-4944-84c4-f4f8d07841a4 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:38:08.251848 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-4fe1df28-2f3c-4d7c-b340-e9e4c48d7743 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:38:08.255603 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-4fe1df28-2f3c-4d7c-b340-e9e4c48d7743 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 094c4fb0-55c2-469b-bbf6-cdd696ba29d0] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:38:08.260337 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4fe1df28-2f3c-4d7c-b340-e9e4c48d7743 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:38:08.260787 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4fe1df28-2f3c-4d7c-b340-e9e4c48d7743 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:38:08.261592 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4fe1df28-2f3c-4d7c-b340-e9e4c48d7743 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:38:08.262029 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4fe1df28-2f3c-4d7c-b340-e9e4c48d7743 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:38:08.263956 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-be677032-1784-41ff-a78a-70a258fbf2e4 req-90927a1c-ca3e-4944-84c4-f4f8d07841a4 service nova] Creating event network-vif-deleted:e1764ec3-2d3a-4526-a3a8-fa6815567096 for instance 094c4fb0-55c2-469b-bbf6-cdd696ba29d0 on hv-cinder-84456 Jun 14 18:38:08.269796 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-be677032-1784-41ff-a78a-70a258fbf2e4 req-90927a1c-ca3e-4944-84c4-f4f8d07841a4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035128 Jun 14 18:38:08.270466 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 544/1111] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:38:08.329011 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-4fe1df28-2f3c-4d7c-b340-e9e4c48d7743 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f183ac34806e46bca89a6c99a8cb62d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f290418a3e42ba962a70a5af666a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:38:08.337350 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-4fe1df28-2f3c-4d7c-b340-e9e4c48d7743 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] 10.222.0.78 "GET /compute/v2.1/servers/094c4fb0-55c2-469b-bbf6-cdd696ba29d0" status: 200 len: 1472 microversion: 2.1 time: 0.089396 Jun 14 18:38:08.337955 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 568/1112] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:38:08 2022] GET /compute/v2.1/servers/094c4fb0-55c2-469b-bbf6-cdd696ba29d0 => generated 1472 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:38:09.355645 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-e8665e25-c866-4635-b40a-33db4804cf68 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:38:09.356340 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-e8665e25-c866-4635-b40a-33db4804cf68 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] [instance: 094c4fb0-55c2-469b-bbf6-cdd696ba29d0] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:38:09.362610 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e8665e25-c866-4635-b40a-33db4804cf68 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:38:09.363060 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e8665e25-c866-4635-b40a-33db4804cf68 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:38:09.363812 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e8665e25-c866-4635-b40a-33db4804cf68 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:38:09.364248 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e8665e25-c866-4635-b40a-33db4804cf68 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:38:09.377678 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.wsgi [None req-e8665e25-c866-4635-b40a-33db4804cf68 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] HTTP exception thrown: Instance 094c4fb0-55c2-469b-bbf6-cdd696ba29d0 could not be found. Jun 14 18:38:09.379907 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-e8665e25-c866-4635-b40a-33db4804cf68 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Request method failure captured: Jun 14 18:38:09.379907 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: request: GET /compute/v2.1/servers/094c4fb0-55c2-469b-bbf6-cdd696ba29d0 HTTP/1.1 Jun 14 18:38:09.379907 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept: application/json Jun 14 18:38:09.379907 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept-Encoding: identity Jun 14 18:38:09.379907 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Connection: close Jun 14 18:38:09.379907 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Length: 0 Jun 14 18:38:09.379907 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Type: application/json Jun 14 18:38:09.379907 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Host: 10.222.0.78 Jun 14 18:38:09.379907 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Openstack-System-Scope: None Jun 14 18:38:09.379907 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: User-Agent: python-urllib3/1.26.9 Jun 14 18:38:09.379907 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Auth-Token: gAAAAABiqNUKS5KQoQZ9mPHmvh270iFLKovjMybDY2Rh4a_B-3kR9dS4FLtzSsC09e8GKM4DymiU81ygOaZJ_Jl3QtEePim0J5WN3mgSZC4xiereL6zkcNSz0WFZR5BqbWgr6ua08ZiZjmHcUaXyizF1hCOwYOpoe6FOP-Hv84hTf_f8uaQWlI0 Jun 14 18:38:09.379907 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Id: None Jun 14 18:38:09.379907 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Name: None Jun 14 18:38:09.379907 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Identity-Status: Confirmed Jun 14 18:38:09.379907 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Is-Admin-Project: True Jun 14 18:38:09.379907 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Id: default Jun 14 18:38:09.379907 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Name: Default Jun 14 18:38:09.379907 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Id: 64f290418a3e42ba962a70a5af666a9d Jun 14 18:38:09.379907 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1941290998 Jun 14 18:38:09.379907 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Role: reader,member Jun 14 18:38:09.379907 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Roles: reader,member Jun 14 18:38:09.381636 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_64f290418a3e42ba962a70a5af666a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/64f290418a3e42ba962a70a5af666a9d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/64f290418a3e42ba962a70a5af666a9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/64f290418a3e42ba962a70a5af666a9d"}]}] Jun 14 18:38:09.381636 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant: tempest-VolumesSnapshotTestJSON-1941290998 Jun 14 18:38:09.381636 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Id: 64f290418a3e42ba962a70a5af666a9d Jun 14 18:38:09.381636 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1941290998 Jun 14 18:38:09.381636 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User: tempest-VolumesSnapshotTestJSON-1941290998-project Jun 14 18:38:09.381636 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Id: default Jun 14 18:38:09.381636 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Name: Default Jun 14 18:38:09.381636 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Id: f183ac34806e46bca89a6c99a8cb62d4 Jun 14 18:38:09.381636 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Name: tempest-VolumesSnapshotTestJSON-1941290998-project Jun 14 18:38:09.381636 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: method: > Jun 14 18:38:09.381636 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: exception: Instance 094c4fb0-55c2-469b-bbf6-cdd696ba29d0 could not be found. Jun 14 18:38:09.381636 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: action_args: {'id': '094c4fb0-55c2-469b-bbf6-cdd696ba29d0'} Jun 14 18:38:09.382611 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:38:09.382611 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:38:09.382611 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:38:09.382611 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:38:09.382611 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:38:09.382611 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:38:09.382611 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:38:09.382611 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:38:09.382611 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:38:09.382611 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:38:09.382611 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 094c4fb0-55c2-469b-bbf6-cdd696ba29d0 could not be found. Jun 14 18:38:09.382611 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:38:09.382611 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:38:09.382611 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:38:09.382611 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:38:09.382611 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:38:09.382611 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:38:09.382611 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:38:09.382611 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:38:09.382611 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:38:09.384411 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:38:09.384411 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:38:09.384411 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:38:09.384411 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:38:09.384411 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:38:09.384411 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:38:09.384411 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:38:09.384411 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 094c4fb0-55c2-469b-bbf6-cdd696ba29d0 could not be found. Jun 14 18:38:09.384411 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:38:09.384411 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:38:09.384411 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:38:09.384411 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:38:09.384411 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:38:09.384411 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:38:09.384411 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:38:09.384411 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:38:09.384411 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 094c4fb0-55c2-469b-bbf6-cdd696ba29d0 could not be found. Jun 14 18:38:09.384411 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:38:09.385971 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-e8665e25-c866-4635-b40a-33db4804cf68 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] Returning 404 to user: Instance 094c4fb0-55c2-469b-bbf6-cdd696ba29d0 could not be found. {{(pid=118623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:38:09.385971 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-e8665e25-c866-4635-b40a-33db4804cf68 tempest-VolumesSnapshotTestJSON-1941290998 tempest-VolumesSnapshotTestJSON-1941290998-project] 10.222.0.78 "GET /compute/v2.1/servers/094c4fb0-55c2-469b-bbf6-cdd696ba29d0" status: 404 len: 111 microversion: 2.1 time: 0.030435 Jun 14 18:38:09.385971 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 545/1113] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:38:09 2022] GET /compute/v2.1/servers/094c4fb0-55c2-469b-bbf6-cdd696ba29d0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:38:58.708189 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 18:38:58.708831 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Tue Jun 14 18:38:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 14 18:39:25.587990 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:39:25.588711 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:39:25.593197 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-54be0c57-c372-4c59-b2d3-d3010e47930e tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:39:25.593732 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-54be0c57-c372-4c59-b2d3-d3010e47930e tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: c004d7e4-71d3-418b-95f2-736cef250bdc] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:39:25.599931 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-54be0c57-c372-4c59-b2d3-d3010e47930e tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:25.600372 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-54be0c57-c372-4c59-b2d3-d3010e47930e tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:25.601148 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-54be0c57-c372-4c59-b2d3-d3010e47930e tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:25.601669 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-54be0c57-c372-4c59-b2d3-d3010e47930e tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:25.627859 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-54be0c57-c372-4c59-b2d3-d3010e47930e tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: c004d7e4-71d3-418b-95f2-736cef250bdc] Going to try to terminate instance {{(pid=118624) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:39:25.916213 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-54be0c57-c372-4c59-b2d3-d3010e47930e tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc" status: 204 len: 0 microversion: 2.1 time: 0.329745 Jun 14 18:39:25.916793 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 569/1114] 10.222.0.78 () {58 vars in 1238 bytes} [Tue Jun 14 18:39:25 2022] DELETE /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 18:39:25.923508 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_api:SELECT=8 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:39:25.924348 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=21,nova_cell1:INSERT=2 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:39:25.928340 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-8fea7752-e208-4098-b68f-e166d68b29be tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:39:25.930520 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-8fea7752-e208-4098-b68f-e166d68b29be tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: c004d7e4-71d3-418b-95f2-736cef250bdc] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:39:25.939276 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8fea7752-e208-4098-b68f-e166d68b29be tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:25.939733 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8fea7752-e208-4098-b68f-e166d68b29be tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:25.940530 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8fea7752-e208-4098-b68f-e166d68b29be tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:25.940968 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-8fea7752-e208-4098-b68f-e166d68b29be tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:26.085935 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-8fea7752-e208-4098-b68f-e166d68b29be tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:39:26.094741 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-8fea7752-e208-4098-b68f-e166d68b29be tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc" status: 200 len: 1578 microversion: 2.1 time: 0.173517 Jun 14 18:39:26.095299 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 546/1115] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:39:25 2022] GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc => generated 1578 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:39:27.112512 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-a804a2a1-0bb5-4fd8-8770-ad68cb529cc1 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:39:27.113214 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-a804a2a1-0bb5-4fd8-8770-ad68cb529cc1 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: c004d7e4-71d3-418b-95f2-736cef250bdc] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:39:27.119829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a804a2a1-0bb5-4fd8-8770-ad68cb529cc1 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:27.120272 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a804a2a1-0bb5-4fd8-8770-ad68cb529cc1 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:27.121936 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a804a2a1-0bb5-4fd8-8770-ad68cb529cc1 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:27.122613 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a804a2a1-0bb5-4fd8-8770-ad68cb529cc1 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:27.262680 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-a804a2a1-0bb5-4fd8-8770-ad68cb529cc1 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:39:27.270432 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-a804a2a1-0bb5-4fd8-8770-ad68cb529cc1 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc" status: 200 len: 1578 microversion: 2.1 time: 0.162261 Jun 14 18:39:27.271005 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 570/1116] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:39:27 2022] GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:39:28.288621 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-cd23e77d-c3ea-4ab8-a5b5-da4e28879874 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:39:28.289261 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-cd23e77d-c3ea-4ab8-a5b5-da4e28879874 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: c004d7e4-71d3-418b-95f2-736cef250bdc] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:39:28.297328 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-cd23e77d-c3ea-4ab8-a5b5-da4e28879874 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:28.297328 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-cd23e77d-c3ea-4ab8-a5b5-da4e28879874 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:28.297877 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-cd23e77d-c3ea-4ab8-a5b5-da4e28879874 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:28.298318 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-cd23e77d-c3ea-4ab8-a5b5-da4e28879874 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:28.383556 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-cd23e77d-c3ea-4ab8-a5b5-da4e28879874 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:39:28.393842 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-cd23e77d-c3ea-4ab8-a5b5-da4e28879874 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc" status: 200 len: 1510 microversion: 2.1 time: 0.109143 Jun 14 18:39:28.395182 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 547/1117] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:39:28 2022] GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc => generated 1510 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:39:28.397415 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-ebb07149-a69f-4864-9f9a-ee683830dddc req-3bf5028f-fc00-49b2-84ed-091047a27ac2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c004d7e4-71d3-418b-95f2-736cef250bdc", "name": "network-vif-deleted", "tag": "3016db14-1b36-475d-ba0c-3b43b39e932c"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:39:28.406845 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-ebb07149-a69f-4864-9f9a-ee683830dddc req-3bf5028f-fc00-49b2-84ed-091047a27ac2 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:28.407284 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-ebb07149-a69f-4864-9f9a-ee683830dddc req-3bf5028f-fc00-49b2-84ed-091047a27ac2 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:28.419401 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-ebb07149-a69f-4864-9f9a-ee683830dddc req-3bf5028f-fc00-49b2-84ed-091047a27ac2 service nova] Creating event network-vif-deleted:3016db14-1b36-475d-ba0c-3b43b39e932c for instance c004d7e4-71d3-418b-95f2-736cef250bdc on hv-cinder-84456 Jun 14 18:39:28.424898 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-ebb07149-a69f-4864-9f9a-ee683830dddc req-3bf5028f-fc00-49b2-84ed-091047a27ac2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031255 Jun 14 18:39:28.428809 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 571/1118] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:39:29.425651 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-a1d06a41-096d-4b8c-885f-ffc973e26159 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:39:29.426284 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-a1d06a41-096d-4b8c-885f-ffc973e26159 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: c004d7e4-71d3-418b-95f2-736cef250bdc] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:39:29.434398 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a1d06a41-096d-4b8c-885f-ffc973e26159 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:29.435011 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a1d06a41-096d-4b8c-885f-ffc973e26159 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:29.435834 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a1d06a41-096d-4b8c-885f-ffc973e26159 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:29.436485 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a1d06a41-096d-4b8c-885f-ffc973e26159 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:29.476997 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a1d06a41-096d-4b8c-885f-ffc973e26159 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:29.477466 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a1d06a41-096d-4b8c-885f-ffc973e26159 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:29.477959 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.objects.instance [None req-a1d06a41-096d-4b8c-885f-ffc973e26159 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lazy-loading 'fault' on Instance uuid c004d7e4-71d3-418b-95f2-736cef250bdc {{(pid=118623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:39:29.526580 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-a1d06a41-096d-4b8c-885f-ffc973e26159 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:39:29.534742 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-a1d06a41-096d-4b8c-885f-ffc973e26159 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc" status: 200 len: 1230 microversion: 2.1 time: 0.113866 Jun 14 18:39:29.543704 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 548/1119] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:39:29 2022] GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc => generated 1230 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:39:30.553932 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-d8f3feb3-1e21-47b2-b9bc-556162d203d9 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:39:30.554623 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-d8f3feb3-1e21-47b2-b9bc-556162d203d9 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: c004d7e4-71d3-418b-95f2-736cef250bdc] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:39:30.562075 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d8f3feb3-1e21-47b2-b9bc-556162d203d9 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:30.562527 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d8f3feb3-1e21-47b2-b9bc-556162d203d9 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:30.563302 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d8f3feb3-1e21-47b2-b9bc-556162d203d9 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:30.563746 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-d8f3feb3-1e21-47b2-b9bc-556162d203d9 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:30.578744 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.wsgi [None req-d8f3feb3-1e21-47b2-b9bc-556162d203d9 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] HTTP exception thrown: Instance c004d7e4-71d3-418b-95f2-736cef250bdc could not be found. Jun 14 18:39:30.580434 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-d8f3feb3-1e21-47b2-b9bc-556162d203d9 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Request method failure captured: Jun 14 18:39:30.580434 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: request: GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc HTTP/1.1 Jun 14 18:39:30.580434 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept: application/json Jun 14 18:39:30.580434 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept-Encoding: identity Jun 14 18:39:30.580434 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Connection: close Jun 14 18:39:30.580434 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Length: 0 Jun 14 18:39:30.580434 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Type: application/json Jun 14 18:39:30.580434 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Host: 10.222.0.78 Jun 14 18:39:30.580434 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Openstack-System-Scope: None Jun 14 18:39:30.580434 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: User-Agent: python-urllib3/1.26.9 Jun 14 18:39:30.580434 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Auth-Token: gAAAAABiqNUXCG8vX8gDa6VOoR71txC2LJ0hlSEz1x40e7ar4jonEJshCGsn_lT5y9wFUTcgun2gfPL29rzC03Om-U3US-cP2R6hC4S830kvAxZbAW3KmUR6xeGd4b9rGuiP1N-YanADr1YP6LwpE8afmLRACwitMVQcjBivdlctRqh-nkdMgzQ Jun 14 18:39:30.580434 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Id: None Jun 14 18:39:30.580434 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Name: None Jun 14 18:39:30.580434 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Identity-Status: Confirmed Jun 14 18:39:30.580434 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Is-Admin-Project: True Jun 14 18:39:30.580434 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Id: default Jun 14 18:39:30.580434 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Name: Default Jun 14 18:39:30.580434 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Id: 4c8c7a8868b741feb66d6a3b8c761d9e Jun 14 18:39:30.580434 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Name: tempest-TestVolumeBootPattern-329983849 Jun 14 18:39:30.580434 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Role: reader,member Jun 14 18:39:30.580434 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Roles: reader,member Jun 14 18:39:30.582138 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4c8c7a8868b741feb66d6a3b8c761d9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4c8c7a8868b741feb66d6a3b8c761d9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4c8c7a8868b741feb66d6a3b8c761d9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4c8c7a8868b741feb66d6a3b8c761d9e"}]}] Jun 14 18:39:30.582138 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant: tempest-TestVolumeBootPattern-329983849 Jun 14 18:39:30.582138 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Id: 4c8c7a8868b741feb66d6a3b8c761d9e Jun 14 18:39:30.582138 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Name: tempest-TestVolumeBootPattern-329983849 Jun 14 18:39:30.582138 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User: tempest-TestVolumeBootPattern-329983849-project Jun 14 18:39:30.582138 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Id: default Jun 14 18:39:30.582138 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Name: Default Jun 14 18:39:30.582138 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Id: f9df6279bdd140448c4f7717942f2beb Jun 14 18:39:30.582138 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Name: tempest-TestVolumeBootPattern-329983849-project Jun 14 18:39:30.582138 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: method: > Jun 14 18:39:30.582138 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: exception: Instance c004d7e4-71d3-418b-95f2-736cef250bdc could not be found. Jun 14 18:39:30.582138 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: action_args: {'id': 'c004d7e4-71d3-418b-95f2-736cef250bdc'} Jun 14 18:39:30.583228 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:39:30.583228 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:39:30.583228 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:39:30.583228 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:39:30.583228 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:39:30.583228 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:39:30.583228 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:39:30.583228 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:39:30.583228 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:39:30.583228 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:39:30.583228 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c004d7e4-71d3-418b-95f2-736cef250bdc could not be found. Jun 14 18:39:30.583228 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:39:30.583228 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:39:30.583228 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:39:30.583228 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:39:30.583228 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:39:30.583228 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:39:30.583228 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:39:30.583228 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:39:30.583228 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:39:30.584829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:39:30.584829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:39:30.584829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:39:30.584829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:39:30.584829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:39:30.584829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:39:30.584829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:39:30.584829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c004d7e4-71d3-418b-95f2-736cef250bdc could not be found. Jun 14 18:39:30.584829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:39:30.584829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:39:30.584829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:39:30.584829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:39:30.584829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:39:30.584829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:39:30.584829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:39:30.584829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:39:30.584829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c004d7e4-71d3-418b-95f2-736cef250bdc could not be found. Jun 14 18:39:30.584829 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:39:30.586255 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-d8f3feb3-1e21-47b2-b9bc-556162d203d9 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Returning 404 to user: Instance c004d7e4-71d3-418b-95f2-736cef250bdc could not be found. {{(pid=118624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:39:30.586255 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-d8f3feb3-1e21-47b2-b9bc-556162d203d9 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc" status: 404 len: 111 microversion: 2.1 time: 0.032666 Jun 14 18:39:30.586255 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 572/1120] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:39:30 2022] GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:39:30.709842 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-e2c77320-554d-4aa9-aa26-3ed0fecb56c7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-560734495", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1923373548", "security_groups": [{"name": "tempest-secgroup-smoke-1112180450"}], "block_device_mapping_v2": [{"uuid": "0d2d0611-6576-44b1-97c3-1bf8cad00ece", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5e1d771e-6723-48d3-994d-42a6b0e70992"}]}} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:39:30.833633 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.network.neutron [None req-e2c77320-554d-4aa9-aa26-3ed0fecb56c7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] validate_networks() for [('5e1d771e-6723-48d3-994d-42a6b0e70992', None, None, None, None, None)] {{(pid=118623) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 18:39:31.281126 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-e2c77320-554d-4aa9-aa26-3ed0fecb56c7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Flavor limits 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 18:39:31.281587 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-e2c77320-554d-4aa9-aa26-3ed0fecb56c7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Image limits 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 18:39:31.282063 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-e2c77320-554d-4aa9-aa26-3ed0fecb56c7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Flavor pref 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 18:39:31.282500 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-e2c77320-554d-4aa9-aa26-3ed0fecb56c7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Image pref 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 18:39:31.282907 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-e2c77320-554d-4aa9-aa26-3ed0fecb56c7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 18:39:31.295829 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e2c77320-554d-4aa9-aa26-3ed0fecb56c7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:31.296279 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e2c77320-554d-4aa9-aa26-3ed0fecb56c7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:31.297069 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e2c77320-554d-4aa9-aa26-3ed0fecb56c7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:31.297711 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-e2c77320-554d-4aa9-aa26-3ed0fecb56c7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:31.315904 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.quota [None req-e2c77320-554d-4aa9-aa26-3ed0fecb56c7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Getting quotas for project 4c8c7a8868b741feb66d6a3b8c761d9e. Resources: {'instances', 'cores', 'ram'} {{(pid=118623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:39:31.320562 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.quota [None req-e2c77320-554d-4aa9-aa26-3ed0fecb56c7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Getting quotas for user f9df6279bdd140448c4f7717942f2beb and project 4c8c7a8868b741feb66d6a3b8c761d9e. Resources: {'instances', 'cores', 'ram'} {{(pid=118623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:39:31.385414 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-e2c77320-554d-4aa9-aa26-3ed0fecb56c7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Going to run 1 instances... {{(pid=118623) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 18:39:31.391753 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-e2c77320-554d-4aa9-aa26-3ed0fecb56c7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 7579bfbd-2387-4568-8c0b-111b987450ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0d2d0611-6576-44b1-97c3-1bf8cad00ece',volume_size=None,volume_type=None)] {{(pid=118623) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 18:39:31.769813 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-e2c77320-554d-4aa9-aa26-3ed0fecb56c7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.063854 Jun 14 18:39:31.770632 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 549/1121] 10.222.0.78 () {60 vars in 1146 bytes} [Tue Jun 14 18:39:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 1065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 18:39:31.781387 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-a0182ae1-4874-4804-abfe-70b1f9bd74dc tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:39:31.782567 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-a0182ae1-4874-4804-abfe-70b1f9bd74dc tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 7579bfbd-2387-4568-8c0b-111b987450ca] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:39:31.851061 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-a0182ae1-4874-4804-abfe-70b1f9bd74dc tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:39:31.860045 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-a0182ae1-4874-4804-abfe-70b1f9bd74dc tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca" status: 200 len: 1094 microversion: 2.1 time: 0.082803 Jun 14 18:39:31.860637 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 573/1122] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:39:31 2022] GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca => generated 1094 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:39:32.878281 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-bf13a596-ce6a-428c-b3b7-615be86760c3 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:39:32.879182 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-bf13a596-ce6a-428c-b3b7-615be86760c3 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 7579bfbd-2387-4568-8c0b-111b987450ca] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:39:32.889308 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-bf13a596-ce6a-428c-b3b7-615be86760c3 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:32.894129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-bf13a596-ce6a-428c-b3b7-615be86760c3 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:32.894129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-bf13a596-ce6a-428c-b3b7-615be86760c3 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:32.894129 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-bf13a596-ce6a-428c-b3b7-615be86760c3 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:32.960285 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-bf13a596-ce6a-428c-b3b7-615be86760c3 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:39:32.969435 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-bf13a596-ce6a-428c-b3b7-615be86760c3 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca" status: 200 len: 1144 microversion: 2.1 time: 0.095589 Jun 14 18:39:32.970286 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 550/1123] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:39:32 2022] GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca => generated 1144 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:39:33.986642 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-896f42b6-68f0-4d5f-b30d-0b9913c06de7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:39:33.987342 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-896f42b6-68f0-4d5f-b30d-0b9913c06de7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 7579bfbd-2387-4568-8c0b-111b987450ca] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:39:33.995138 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-896f42b6-68f0-4d5f-b30d-0b9913c06de7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:33.996742 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-896f42b6-68f0-4d5f-b30d-0b9913c06de7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:33.997877 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-896f42b6-68f0-4d5f-b30d-0b9913c06de7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:33.998548 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-896f42b6-68f0-4d5f-b30d-0b9913c06de7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:34.065510 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-896f42b6-68f0-4d5f-b30d-0b9913c06de7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:39:34.073385 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-896f42b6-68f0-4d5f-b30d-0b9913c06de7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca" status: 200 len: 1210 microversion: 2.1 time: 0.090377 Jun 14 18:39:34.073924 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 574/1124] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:39:33 2022] GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:39:35.092383 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-23edbdc8-50c8-4d0d-8055-18ae8aafe271 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:39:35.093001 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-23edbdc8-50c8-4d0d-8055-18ae8aafe271 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 7579bfbd-2387-4568-8c0b-111b987450ca] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:39:35.102125 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-23edbdc8-50c8-4d0d-8055-18ae8aafe271 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:35.102679 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-23edbdc8-50c8-4d0d-8055-18ae8aafe271 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:35.103352 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-23edbdc8-50c8-4d0d-8055-18ae8aafe271 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:35.103796 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-23edbdc8-50c8-4d0d-8055-18ae8aafe271 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:35.323043 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-23edbdc8-50c8-4d0d-8055-18ae8aafe271 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:39:35.333211 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-23edbdc8-50c8-4d0d-8055-18ae8aafe271 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca" status: 200 len: 1278 microversion: 2.1 time: 0.245836 Jun 14 18:39:35.334493 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 551/1125] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:39:35 2022] GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca => generated 1278 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:39:35.767684 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-e64beb38-05dd-4b6f-9f4b-0d91fc4c897c req-39b99572-03b5-4fd2-874c-5187eed55461 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7579bfbd-2387-4568-8c0b-111b987450ca", "tag": "e381693f-6e0b-4d1d-87a0-51d476d74063"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:39:35.784482 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-e64beb38-05dd-4b6f-9f4b-0d91fc4c897c req-39b99572-03b5-4fd2-874c-5187eed55461 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:35.784996 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-e64beb38-05dd-4b6f-9f4b-0d91fc4c897c req-39b99572-03b5-4fd2-874c-5187eed55461 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:35.799768 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-e64beb38-05dd-4b6f-9f4b-0d91fc4c897c req-39b99572-03b5-4fd2-874c-5187eed55461 service nova] Creating event network-changed:e381693f-6e0b-4d1d-87a0-51d476d74063 for instance 7579bfbd-2387-4568-8c0b-111b987450ca on hv-cinder-84456 Jun 14 18:39:35.805774 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-e64beb38-05dd-4b6f-9f4b-0d91fc4c897c req-39b99572-03b5-4fd2-874c-5187eed55461 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043427 Jun 14 18:39:35.806748 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 575/1126] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:39:36.357997 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-3768a855-898b-454c-a170-7ed0dfc8c8ca tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:39:36.358824 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-3768a855-898b-454c-a170-7ed0dfc8c8ca tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 7579bfbd-2387-4568-8c0b-111b987450ca] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:39:36.365821 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3768a855-898b-454c-a170-7ed0dfc8c8ca tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:36.366434 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3768a855-898b-454c-a170-7ed0dfc8c8ca tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:36.367228 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3768a855-898b-454c-a170-7ed0dfc8c8ca tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:36.367668 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3768a855-898b-454c-a170-7ed0dfc8c8ca tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:36.603588 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-3768a855-898b-454c-a170-7ed0dfc8c8ca tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:39:36.612871 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-3768a855-898b-454c-a170-7ed0dfc8c8ca tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca" status: 200 len: 1266 microversion: 2.1 time: 0.259708 Jun 14 18:39:36.613529 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 552/1127] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:39:36 2022] GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca => generated 1266 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:39:37.632500 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-ff7cbafc-fb0a-41f3-bb40-53859c80fc9f tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:39:37.633108 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-ff7cbafc-fb0a-41f3-bb40-53859c80fc9f tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 7579bfbd-2387-4568-8c0b-111b987450ca] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:39:37.640042 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ff7cbafc-fb0a-41f3-bb40-53859c80fc9f tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:37.640487 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ff7cbafc-fb0a-41f3-bb40-53859c80fc9f tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:37.641247 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ff7cbafc-fb0a-41f3-bb40-53859c80fc9f tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:37.641700 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-ff7cbafc-fb0a-41f3-bb40-53859c80fc9f tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:37.779414 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-ff7cbafc-fb0a-41f3-bb40-53859c80fc9f tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:39:37.787397 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-ff7cbafc-fb0a-41f3-bb40-53859c80fc9f tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca" status: 200 len: 1266 microversion: 2.1 time: 0.159541 Jun 14 18:39:37.787978 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 576/1128] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:39:37 2022] GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:39:38.804795 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-afd6bab2-3e9b-4def-b6ef-026e2c7f7c3c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:39:38.805411 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-afd6bab2-3e9b-4def-b6ef-026e2c7f7c3c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 7579bfbd-2387-4568-8c0b-111b987450ca] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:39:38.813186 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-afd6bab2-3e9b-4def-b6ef-026e2c7f7c3c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:38.813679 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-afd6bab2-3e9b-4def-b6ef-026e2c7f7c3c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:38.814449 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-afd6bab2-3e9b-4def-b6ef-026e2c7f7c3c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:38.814890 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-afd6bab2-3e9b-4def-b6ef-026e2c7f7c3c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:38.960386 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-afd6bab2-3e9b-4def-b6ef-026e2c7f7c3c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:39:38.970299 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-afd6bab2-3e9b-4def-b6ef-026e2c7f7c3c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca" status: 200 len: 1266 microversion: 2.1 time: 0.169290 Jun 14 18:39:38.970896 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 553/1129] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:39:38 2022] GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:39:39.988868 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-4bc47571-0a42-45e3-bb32-94e793d179d2 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:39:39.989491 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-4bc47571-0a42-45e3-bb32-94e793d179d2 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 7579bfbd-2387-4568-8c0b-111b987450ca] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:39:39.996056 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4bc47571-0a42-45e3-bb32-94e793d179d2 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:39.996506 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4bc47571-0a42-45e3-bb32-94e793d179d2 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:39.997267 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4bc47571-0a42-45e3-bb32-94e793d179d2 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:39.998501 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-4bc47571-0a42-45e3-bb32-94e793d179d2 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:40.133081 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-4bc47571-0a42-45e3-bb32-94e793d179d2 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:39:40.140596 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-4bc47571-0a42-45e3-bb32-94e793d179d2 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca" status: 200 len: 1266 microversion: 2.1 time: 0.155612 Jun 14 18:39:40.141159 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 577/1130] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:39:39 2022] GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:39:41.159447 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-14b363f8-461e-4f58-abfd-8271431fb692 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:39:41.160058 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-14b363f8-461e-4f58-abfd-8271431fb692 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 7579bfbd-2387-4568-8c0b-111b987450ca] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:39:41.166533 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-14b363f8-461e-4f58-abfd-8271431fb692 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:41.166979 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-14b363f8-461e-4f58-abfd-8271431fb692 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:41.167740 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-14b363f8-461e-4f58-abfd-8271431fb692 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:41.168178 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-14b363f8-461e-4f58-abfd-8271431fb692 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:41.304931 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell0:SELECT=2 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:39:41.308753 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-14b363f8-461e-4f58-abfd-8271431fb692 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:39:41.316722 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-14b363f8-461e-4f58-abfd-8271431fb692 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca" status: 200 len: 1266 microversion: 2.1 time: 0.163406 Jun 14 18:39:41.317348 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 554/1131] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:39:41 2022] GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:39:42.334309 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-7c10638d-b222-4ed9-94fa-0f7cc3d33942 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:39:42.334892 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-7c10638d-b222-4ed9-94fa-0f7cc3d33942 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 7579bfbd-2387-4568-8c0b-111b987450ca] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:39:42.337305 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell0:SELECT=2 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:39:42.342407 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7c10638d-b222-4ed9-94fa-0f7cc3d33942 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:42.351821 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7c10638d-b222-4ed9-94fa-0f7cc3d33942 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:42.351821 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7c10638d-b222-4ed9-94fa-0f7cc3d33942 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:42.351821 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7c10638d-b222-4ed9-94fa-0f7cc3d33942 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:42.485270 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-7c10638d-b222-4ed9-94fa-0f7cc3d33942 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:39:42.492987 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-7c10638d-b222-4ed9-94fa-0f7cc3d33942 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca" status: 200 len: 1266 microversion: 2.1 time: 0.162595 Jun 14 18:39:42.493582 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 578/1132] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:39:42 2022] GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:39:43.510351 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-44890f7c-b6b2-4cd4-aa6f-218835dda894 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:39:43.511026 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-44890f7c-b6b2-4cd4-aa6f-218835dda894 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 7579bfbd-2387-4568-8c0b-111b987450ca] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:39:43.513197 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell0:SELECT=6 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:39:43.518635 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-44890f7c-b6b2-4cd4-aa6f-218835dda894 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:43.519079 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-44890f7c-b6b2-4cd4-aa6f-218835dda894 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:43.519832 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-44890f7c-b6b2-4cd4-aa6f-218835dda894 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:43.520264 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-44890f7c-b6b2-4cd4-aa6f-218835dda894 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:43.651718 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-44890f7c-b6b2-4cd4-aa6f-218835dda894 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:39:43.659993 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-44890f7c-b6b2-4cd4-aa6f-218835dda894 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca" status: 200 len: 1266 microversion: 2.1 time: 0.153662 Jun 14 18:39:43.660557 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 555/1133] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:39:43 2022] GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:39:44.676994 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-899108ff-f0e4-4397-9f62-feaacbfd1ec8 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:39:44.677634 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-899108ff-f0e4-4397-9f62-feaacbfd1ec8 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 7579bfbd-2387-4568-8c0b-111b987450ca] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:39:44.684187 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-899108ff-f0e4-4397-9f62-feaacbfd1ec8 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:44.684636 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-899108ff-f0e4-4397-9f62-feaacbfd1ec8 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:44.686063 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-899108ff-f0e4-4397-9f62-feaacbfd1ec8 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:44.686475 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-899108ff-f0e4-4397-9f62-feaacbfd1ec8 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:44.820288 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-899108ff-f0e4-4397-9f62-feaacbfd1ec8 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:39:44.827825 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-899108ff-f0e4-4397-9f62-feaacbfd1ec8 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca" status: 200 len: 1266 microversion: 2.1 time: 0.154869 Jun 14 18:39:44.828389 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 579/1134] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:39:44 2022] GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:39:45.844244 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-3de43952-367b-402e-a28e-a0b264ffe8f7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:39:45.844848 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-3de43952-367b-402e-a28e-a0b264ffe8f7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 7579bfbd-2387-4568-8c0b-111b987450ca] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:39:45.851367 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3de43952-367b-402e-a28e-a0b264ffe8f7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:45.851815 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3de43952-367b-402e-a28e-a0b264ffe8f7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:45.854901 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3de43952-367b-402e-a28e-a0b264ffe8f7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:45.854901 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3de43952-367b-402e-a28e-a0b264ffe8f7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:45.993208 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-3de43952-367b-402e-a28e-a0b264ffe8f7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:39:46.001676 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-3de43952-367b-402e-a28e-a0b264ffe8f7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca" status: 200 len: 1266 microversion: 2.1 time: 0.161248 Jun 14 18:39:46.002238 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 556/1135] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:39:45 2022] GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:39:47.018724 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-da0b9f90-c2e4-4a82-8519-fc42e6f7c4fd tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:39:47.019322 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-da0b9f90-c2e4-4a82-8519-fc42e6f7c4fd tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 7579bfbd-2387-4568-8c0b-111b987450ca] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:39:47.026170 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-da0b9f90-c2e4-4a82-8519-fc42e6f7c4fd tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:47.026616 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-da0b9f90-c2e4-4a82-8519-fc42e6f7c4fd tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:47.027381 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-da0b9f90-c2e4-4a82-8519-fc42e6f7c4fd tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:47.027812 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-da0b9f90-c2e4-4a82-8519-fc42e6f7c4fd tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:47.162712 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-da0b9f90-c2e4-4a82-8519-fc42e6f7c4fd tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:39:47.171376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-da0b9f90-c2e4-4a82-8519-fc42e6f7c4fd tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca" status: 200 len: 1266 microversion: 2.1 time: 0.156438 Jun 14 18:39:47.171960 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 580/1136] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:39:47 2022] GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:39:47.858690 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [req-f6122a0e-e1e4-450a-a9f5-56e2fc8f33ff req-dd0fa534-a747-4e59-9e8f-7978429c80c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7579bfbd-2387-4568-8c0b-111b987450ca", "name": "network-vif-plugged", "status": "completed", "tag": "e381693f-6e0b-4d1d-87a0-51d476d74063"}]} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:39:47.867075 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-f6122a0e-e1e4-450a-a9f5-56e2fc8f33ff req-dd0fa534-a747-4e59-9e8f-7978429c80c0 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:47.867512 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [req-f6122a0e-e1e4-450a-a9f5-56e2fc8f33ff req-dd0fa534-a747-4e59-9e8f-7978429c80c0 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:47.879848 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.compute.server_external_events [req-f6122a0e-e1e4-450a-a9f5-56e2fc8f33ff req-dd0fa534-a747-4e59-9e8f-7978429c80c0 service nova] Creating event network-vif-plugged:e381693f-6e0b-4d1d-87a0-51d476d74063 for instance 7579bfbd-2387-4568-8c0b-111b987450ca on hv-cinder-84456 Jun 14 18:39:47.885432 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [req-f6122a0e-e1e4-450a-a9f5-56e2fc8f33ff req-dd0fa534-a747-4e59-9e8f-7978429c80c0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169641 Jun 14 18:39:47.886042 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 557/1137] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:39:48.188617 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-e2023692-9e34-4d0f-bccc-ad287985affa tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:39:48.193811 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-e2023692-9e34-4d0f-bccc-ad287985affa tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 7579bfbd-2387-4568-8c0b-111b987450ca] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:39:48.196124 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e2023692-9e34-4d0f-bccc-ad287985affa tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:48.196637 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e2023692-9e34-4d0f-bccc-ad287985affa tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:48.197513 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e2023692-9e34-4d0f-bccc-ad287985affa tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:48.197949 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e2023692-9e34-4d0f-bccc-ad287985affa tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:48.344781 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-e2023692-9e34-4d0f-bccc-ad287985affa tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:39:48.352505 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-e2023692-9e34-4d0f-bccc-ad287985affa tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca" status: 200 len: 1266 microversion: 2.1 time: 0.168243 Jun 14 18:39:48.353081 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 581/1138] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:39:48 2022] GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:39:49.370471 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-249acc2a-dde2-49cc-aedf-74abf66a4e8c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:39:49.371175 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-249acc2a-dde2-49cc-aedf-74abf66a4e8c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 7579bfbd-2387-4568-8c0b-111b987450ca] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:39:49.379006 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-249acc2a-dde2-49cc-aedf-74abf66a4e8c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:49.379456 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-249acc2a-dde2-49cc-aedf-74abf66a4e8c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:49.380232 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-249acc2a-dde2-49cc-aedf-74abf66a4e8c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:49.380666 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-249acc2a-dde2-49cc-aedf-74abf66a4e8c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:49.523069 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-249acc2a-dde2-49cc-aedf-74abf66a4e8c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:39:49.531364 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-249acc2a-dde2-49cc-aedf-74abf66a4e8c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca" status: 200 len: 1266 microversion: 2.1 time: 0.165233 Jun 14 18:39:49.531930 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 558/1139] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:39:49 2022] GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:39:50.249369 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 18:39:50.249673 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Tue Jun 14 18:39:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 14 18:39:50.549085 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-e80ea16f-cfc7-4583-a19c-5e228f14ca42 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:39:50.549680 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-e80ea16f-cfc7-4583-a19c-5e228f14ca42 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 7579bfbd-2387-4568-8c0b-111b987450ca] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:39:50.556445 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e80ea16f-cfc7-4583-a19c-5e228f14ca42 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:50.556898 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e80ea16f-cfc7-4583-a19c-5e228f14ca42 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:50.557706 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e80ea16f-cfc7-4583-a19c-5e228f14ca42 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:50.558154 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-e80ea16f-cfc7-4583-a19c-5e228f14ca42 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:50.714960 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-e80ea16f-cfc7-4583-a19c-5e228f14ca42 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:39:50.723491 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-e80ea16f-cfc7-4583-a19c-5e228f14ca42 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca" status: 200 len: 1453 microversion: 2.1 time: 0.179069 Jun 14 18:39:50.724067 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 582/1140] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:39:50 2022] GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca => generated 1453 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:39:50.739618 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-2c9da325-aa10-4af3-a96c-5fba4fede8ec tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:39:50.740260 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-2c9da325-aa10-4af3-a96c-5fba4fede8ec tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 7579bfbd-2387-4568-8c0b-111b987450ca] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:39:50.747242 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2c9da325-aa10-4af3-a96c-5fba4fede8ec tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:50.747731 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2c9da325-aa10-4af3-a96c-5fba4fede8ec tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:50.748514 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2c9da325-aa10-4af3-a96c-5fba4fede8ec tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:50.748946 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-2c9da325-aa10-4af3-a96c-5fba4fede8ec tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:50.891036 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-2c9da325-aa10-4af3-a96c-5fba4fede8ec tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:39:50.899909 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-2c9da325-aa10-4af3-a96c-5fba4fede8ec tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca" status: 200 len: 1453 microversion: 2.1 time: 0.163836 Jun 14 18:39:50.900481 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 559/1141] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:39:50 2022] GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca => generated 1453 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:39:52.936070 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-303f9d3d-e81e-47f4-9e6e-d028bce1ff48 req-80092e2f-785d-47c6-b9d8-d8c3585f1e42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7579bfbd-2387-4568-8c0b-111b987450ca", "tag": "e381693f-6e0b-4d1d-87a0-51d476d74063"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:39:52.946112 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-303f9d3d-e81e-47f4-9e6e-d028bce1ff48 req-80092e2f-785d-47c6-b9d8-d8c3585f1e42 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:39:52.946112 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-303f9d3d-e81e-47f4-9e6e-d028bce1ff48 req-80092e2f-785d-47c6-b9d8-d8c3585f1e42 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:39:52.958016 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-303f9d3d-e81e-47f4-9e6e-d028bce1ff48 req-80092e2f-785d-47c6-b9d8-d8c3585f1e42 service nova] Creating event network-changed:e381693f-6e0b-4d1d-87a0-51d476d74063 for instance 7579bfbd-2387-4568-8c0b-111b987450ca on hv-cinder-84456 Jun 14 18:39:52.963298 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-303f9d3d-e81e-47f4-9e6e-d028bce1ff48 req-80092e2f-785d-47c6-b9d8-d8c3585f1e42 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031438 Jun 14 18:39:52.964117 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 583/1142] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:41:31.609951 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:41:31.610810 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell1:SELECT=78 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:41:31.614811 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-f9b7e102-a519-4d66-8657-0e7eb3d560a4 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1192559743", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1923373548", "security_groups": [{"name": "tempest-secgroup-smoke-1112180450"}], "block_device_mapping_v2": [{"uuid": "d93171d7-52a9-405a-9bce-e0be2beb6055", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5e1d771e-6723-48d3-994d-42a6b0e70992"}]}} {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:41:31.728814 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.network.neutron [None req-f9b7e102-a519-4d66-8657-0e7eb3d560a4 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] validate_networks() for [('5e1d771e-6723-48d3-994d-42a6b0e70992', None, None, None, None, None)] {{(pid=118623) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 18:41:32.452851 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-f9b7e102-a519-4d66-8657-0e7eb3d560a4 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Flavor limits 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 18:41:32.453269 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-f9b7e102-a519-4d66-8657-0e7eb3d560a4 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Image limits 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 18:41:32.453769 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-f9b7e102-a519-4d66-8657-0e7eb3d560a4 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Flavor pref 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 18:41:32.454196 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-f9b7e102-a519-4d66-8657-0e7eb3d560a4 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Image pref 0:0:0 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 18:41:32.454643 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.virt.hardware [None req-f9b7e102-a519-4d66-8657-0e7eb3d560a4 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 18:41:32.463615 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f9b7e102-a519-4d66-8657-0e7eb3d560a4 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:41:32.464092 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f9b7e102-a519-4d66-8657-0e7eb3d560a4 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:41:32.464872 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f9b7e102-a519-4d66-8657-0e7eb3d560a4 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:41:32.465301 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-f9b7e102-a519-4d66-8657-0e7eb3d560a4 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:41:32.488293 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.quota [None req-f9b7e102-a519-4d66-8657-0e7eb3d560a4 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Getting quotas for project 4c8c7a8868b741feb66d6a3b8c761d9e. Resources: {'instances', 'cores', 'ram'} {{(pid=118623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:41:32.488806 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.quota [None req-f9b7e102-a519-4d66-8657-0e7eb3d560a4 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Getting quotas for user f9df6279bdd140448c4f7717942f2beb and project 4c8c7a8868b741feb66d6a3b8c761d9e. Resources: {'instances', 'cores', 'ram'} {{(pid=118623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:41:32.546145 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-f9b7e102-a519-4d66-8657-0e7eb3d560a4 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Going to run 1 instances... {{(pid=118623) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 18:41:32.549037 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-f9b7e102-a519-4d66-8657-0e7eb3d560a4 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 17617406-8552-41a3-af72-233263b37ee1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d93171d7-52a9-405a-9bce-e0be2beb6055',volume_size=None,volume_type=None)] {{(pid=118623) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 18:41:32.885296 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-f9b7e102-a519-4d66-8657-0e7eb3d560a4 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.277069 Jun 14 18:41:32.886032 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 560/1143] 10.222.0.78 () {60 vars in 1146 bytes} [Tue Jun 14 18:41:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 1278 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 18:41:32.895252 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR oslo.messaging._drivers.impl_rabbit [-] [29e2d05a-9198-405f-bd9a-511aef4caff5] AMQP server on 10.222.0.78:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 14 18:41:32.895872 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:41:32.896894 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:41:32.901412 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-fd2ac7bd-b2d2-4fa1-a6bc-38ae16463414 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:41:32.902138 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-fd2ac7bd-b2d2-4fa1-a6bc-38ae16463414 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 17617406-8552-41a3-af72-233263b37ee1] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:41:32.959142 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-fd2ac7bd-b2d2-4fa1-a6bc-38ae16463414 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:41:32.966608 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-fd2ac7bd-b2d2-4fa1-a6bc-38ae16463414 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/17617406-8552-41a3-af72-233263b37ee1" status: 200 len: 1095 microversion: 2.1 time: 0.074447 Jun 14 18:41:32.968515 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 584/1144] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:41:32 2022] GET /compute/v2.1/servers/17617406-8552-41a3-af72-233263b37ee1 => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:41:33.984950 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-42f3486d-add3-4306-b053-8896684c247c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:41:33.985736 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-42f3486d-add3-4306-b053-8896684c247c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 17617406-8552-41a3-af72-233263b37ee1] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:41:33.993727 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-42f3486d-add3-4306-b053-8896684c247c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:41:33.994180 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-42f3486d-add3-4306-b053-8896684c247c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:41:33.994952 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-42f3486d-add3-4306-b053-8896684c247c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:41:33.995441 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-42f3486d-add3-4306-b053-8896684c247c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:41:34.057214 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-42f3486d-add3-4306-b053-8896684c247c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:41:34.064866 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-42f3486d-add3-4306-b053-8896684c247c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/17617406-8552-41a3-af72-233263b37ee1" status: 200 len: 1137 microversion: 2.1 time: 0.084007 Jun 14 18:41:34.065707 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 561/1145] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:41:33 2022] GET /compute/v2.1/servers/17617406-8552-41a3-af72-233263b37ee1 => generated 1137 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:41:35.087540 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-11641acf-831a-4ece-85f2-e26a54bcb80b tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:41:35.088149 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-11641acf-831a-4ece-85f2-e26a54bcb80b tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 17617406-8552-41a3-af72-233263b37ee1] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:41:35.098726 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-11641acf-831a-4ece-85f2-e26a54bcb80b tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:41:35.099492 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-11641acf-831a-4ece-85f2-e26a54bcb80b tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:41:35.100272 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-11641acf-831a-4ece-85f2-e26a54bcb80b tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:41:35.100707 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-11641acf-831a-4ece-85f2-e26a54bcb80b tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:41:35.121075 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO oslo.messaging._drivers.impl_rabbit [-] [29e2d05a-9198-405f-bd9a-511aef4caff5] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 45118. Jun 14 18:41:35.167925 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-11641acf-831a-4ece-85f2-e26a54bcb80b tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:41:35.176038 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-11641acf-831a-4ece-85f2-e26a54bcb80b tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/17617406-8552-41a3-af72-233263b37ee1" status: 200 len: 1211 microversion: 2.1 time: 0.092702 Jun 14 18:41:35.176623 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 585/1146] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:41:35 2022] GET /compute/v2.1/servers/17617406-8552-41a3-af72-233263b37ee1 => generated 1211 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:41:36.193146 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-3a2bbd8b-656b-431e-8b78-36be1dfbfa0d tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:41:36.193793 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-3a2bbd8b-656b-431e-8b78-36be1dfbfa0d tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 17617406-8552-41a3-af72-233263b37ee1] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:41:36.200322 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3a2bbd8b-656b-431e-8b78-36be1dfbfa0d tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:41:36.200780 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3a2bbd8b-656b-431e-8b78-36be1dfbfa0d tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:41:36.201600 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3a2bbd8b-656b-431e-8b78-36be1dfbfa0d tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:41:36.202037 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-3a2bbd8b-656b-431e-8b78-36be1dfbfa0d tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:41:36.325190 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-67acd408-6dc5-4806-85bd-058b53f9de28 req-6fb5476a-c11b-42b3-9faf-26329440c0a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17617406-8552-41a3-af72-233263b37ee1", "tag": "859bffd8-598b-4d49-80fd-4bca38b933fb"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:41:36.337091 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-67acd408-6dc5-4806-85bd-058b53f9de28 req-6fb5476a-c11b-42b3-9faf-26329440c0a9 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:41:36.337576 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-67acd408-6dc5-4806-85bd-058b53f9de28 req-6fb5476a-c11b-42b3-9faf-26329440c0a9 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:41:36.355340 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-67acd408-6dc5-4806-85bd-058b53f9de28 req-6fb5476a-c11b-42b3-9faf-26329440c0a9 service nova] Creating event network-changed:859bffd8-598b-4d49-80fd-4bca38b933fb for instance 17617406-8552-41a3-af72-233263b37ee1 on hv-cinder-84456 Jun 14 18:41:36.361601 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-67acd408-6dc5-4806-85bd-058b53f9de28 req-6fb5476a-c11b-42b3-9faf-26329440c0a9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040347 Jun 14 18:41:36.363122 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 586/1147] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:41:36.454161 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-3a2bbd8b-656b-431e-8b78-36be1dfbfa0d tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:41:36.468370 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-3a2bbd8b-656b-431e-8b78-36be1dfbfa0d tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/17617406-8552-41a3-af72-233263b37ee1" status: 200 len: 1267 microversion: 2.1 time: 0.280012 Jun 14 18:41:36.479496 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 562/1148] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:41:36 2022] GET /compute/v2.1/servers/17617406-8552-41a3-af72-233263b37ee1 => generated 1267 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:41:37.487622 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-25597c75-7c36-4a17-841a-4edc215e8abe tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:41:37.488315 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-25597c75-7c36-4a17-841a-4edc215e8abe tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 17617406-8552-41a3-af72-233263b37ee1] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:41:37.495162 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-25597c75-7c36-4a17-841a-4edc215e8abe tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:41:37.495608 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-25597c75-7c36-4a17-841a-4edc215e8abe tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:41:37.496362 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-25597c75-7c36-4a17-841a-4edc215e8abe tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:41:37.496793 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-25597c75-7c36-4a17-841a-4edc215e8abe tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:41:37.634021 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-25597c75-7c36-4a17-841a-4edc215e8abe tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:41:37.641479 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-25597c75-7c36-4a17-841a-4edc215e8abe tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/17617406-8552-41a3-af72-233263b37ee1" status: 200 len: 1267 microversion: 2.1 time: 0.158703 Jun 14 18:41:37.642051 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 587/1149] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:41:37 2022] GET /compute/v2.1/servers/17617406-8552-41a3-af72-233263b37ee1 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:41:38.659209 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-862032f8-115f-4f70-aacf-0c25cc1826cc tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:41:38.659805 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-862032f8-115f-4f70-aacf-0c25cc1826cc tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 17617406-8552-41a3-af72-233263b37ee1] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:41:38.666410 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-862032f8-115f-4f70-aacf-0c25cc1826cc tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:41:38.666859 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-862032f8-115f-4f70-aacf-0c25cc1826cc tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:41:38.667623 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-862032f8-115f-4f70-aacf-0c25cc1826cc tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:41:38.668074 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-862032f8-115f-4f70-aacf-0c25cc1826cc tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:41:38.805391 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-862032f8-115f-4f70-aacf-0c25cc1826cc tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:41:38.812952 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-862032f8-115f-4f70-aacf-0c25cc1826cc tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/17617406-8552-41a3-af72-233263b37ee1" status: 200 len: 1267 microversion: 2.1 time: 0.157798 Jun 14 18:41:38.813529 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 563/1150] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:41:38 2022] GET /compute/v2.1/servers/17617406-8552-41a3-af72-233263b37ee1 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:41:39.830050 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-1b048936-ad6d-405f-8520-aa7fa485210f tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:41:39.831388 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-1b048936-ad6d-405f-8520-aa7fa485210f tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 17617406-8552-41a3-af72-233263b37ee1] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:41:39.837947 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1b048936-ad6d-405f-8520-aa7fa485210f tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:41:39.838335 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1b048936-ad6d-405f-8520-aa7fa485210f tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:41:39.839112 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1b048936-ad6d-405f-8520-aa7fa485210f tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:41:39.839788 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1b048936-ad6d-405f-8520-aa7fa485210f tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:41:39.972624 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-1b048936-ad6d-405f-8520-aa7fa485210f tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:41:39.980105 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-1b048936-ad6d-405f-8520-aa7fa485210f tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/17617406-8552-41a3-af72-233263b37ee1" status: 200 len: 1267 microversion: 2.1 time: 0.153886 Jun 14 18:41:39.980651 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 588/1151] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:41:39 2022] GET /compute/v2.1/servers/17617406-8552-41a3-af72-233263b37ee1 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:41:40.996899 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-7f2b54a5-fbaf-415a-8dfe-71adc7d2a459 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:41:40.997526 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-7f2b54a5-fbaf-415a-8dfe-71adc7d2a459 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 17617406-8552-41a3-af72-233263b37ee1] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:41:41.004151 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7f2b54a5-fbaf-415a-8dfe-71adc7d2a459 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:41:41.004607 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7f2b54a5-fbaf-415a-8dfe-71adc7d2a459 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:41:41.005372 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7f2b54a5-fbaf-415a-8dfe-71adc7d2a459 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:41:41.005837 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7f2b54a5-fbaf-415a-8dfe-71adc7d2a459 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:41:41.134931 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-7f2b54a5-fbaf-415a-8dfe-71adc7d2a459 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:41:41.142390 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-7f2b54a5-fbaf-415a-8dfe-71adc7d2a459 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/17617406-8552-41a3-af72-233263b37ee1" status: 200 len: 1267 microversion: 2.1 time: 0.149430 Jun 14 18:41:41.143459 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 564/1152] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:41:40 2022] GET /compute/v2.1/servers/17617406-8552-41a3-af72-233263b37ee1 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:41:42.160591 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-14834d9d-708c-44b9-bc84-8d204f4bca88 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:41:42.161197 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-14834d9d-708c-44b9-bc84-8d204f4bca88 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 17617406-8552-41a3-af72-233263b37ee1] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:41:42.167710 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-14834d9d-708c-44b9-bc84-8d204f4bca88 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:41:42.168154 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-14834d9d-708c-44b9-bc84-8d204f4bca88 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:41:42.168915 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-14834d9d-708c-44b9-bc84-8d204f4bca88 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:41:42.169400 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-14834d9d-708c-44b9-bc84-8d204f4bca88 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:41:42.305012 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-14834d9d-708c-44b9-bc84-8d204f4bca88 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:41:42.312365 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-14834d9d-708c-44b9-bc84-8d204f4bca88 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/17617406-8552-41a3-af72-233263b37ee1" status: 200 len: 1267 microversion: 2.1 time: 0.156362 Jun 14 18:41:42.313169 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 589/1153] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:41:42 2022] GET /compute/v2.1/servers/17617406-8552-41a3-af72-233263b37ee1 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:41:43.329691 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-839c59b7-daf0-49e0-8181-57f6c2f69d28 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:41:43.332241 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-839c59b7-daf0-49e0-8181-57f6c2f69d28 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 17617406-8552-41a3-af72-233263b37ee1] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:41:43.333178 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell0:SELECT=2 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:41:43.333865 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell0:SELECT=6 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:41:43.338627 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-839c59b7-daf0-49e0-8181-57f6c2f69d28 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:41:43.339070 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-839c59b7-daf0-49e0-8181-57f6c2f69d28 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:41:43.339824 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-839c59b7-daf0-49e0-8181-57f6c2f69d28 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:41:43.340251 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-839c59b7-daf0-49e0-8181-57f6c2f69d28 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:41:43.471378 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-839c59b7-daf0-49e0-8181-57f6c2f69d28 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:41:43.479669 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-839c59b7-daf0-49e0-8181-57f6c2f69d28 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/17617406-8552-41a3-af72-233263b37ee1" status: 200 len: 1267 microversion: 2.1 time: 0.153894 Jun 14 18:41:43.480224 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 565/1154] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:41:43 2022] GET /compute/v2.1/servers/17617406-8552-41a3-af72-233263b37ee1 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:41:44.496306 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-22f94679-ed55-42a7-913e-cd8a61fc27b0 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:41:44.496830 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-22f94679-ed55-42a7-913e-cd8a61fc27b0 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 17617406-8552-41a3-af72-233263b37ee1] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:41:44.498827 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell0:SELECT=2 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:41:44.504154 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-22f94679-ed55-42a7-913e-cd8a61fc27b0 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:41:44.510570 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-22f94679-ed55-42a7-913e-cd8a61fc27b0 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:41:44.510570 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-22f94679-ed55-42a7-913e-cd8a61fc27b0 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:41:44.510570 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-22f94679-ed55-42a7-913e-cd8a61fc27b0 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:41:44.640475 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-22f94679-ed55-42a7-913e-cd8a61fc27b0 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:41:44.649025 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-22f94679-ed55-42a7-913e-cd8a61fc27b0 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/17617406-8552-41a3-af72-233263b37ee1" status: 200 len: 1267 microversion: 2.1 time: 0.156615 Jun 14 18:41:44.649629 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 590/1155] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:41:44 2022] GET /compute/v2.1/servers/17617406-8552-41a3-af72-233263b37ee1 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:41:45.666455 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-fb2f6004-90ec-4112-868d-2647ca465647 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:41:45.667042 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-fb2f6004-90ec-4112-868d-2647ca465647 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 17617406-8552-41a3-af72-233263b37ee1] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:41:45.673619 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-fb2f6004-90ec-4112-868d-2647ca465647 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:41:45.674066 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-fb2f6004-90ec-4112-868d-2647ca465647 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:41:45.674862 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-fb2f6004-90ec-4112-868d-2647ca465647 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:41:45.675301 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-fb2f6004-90ec-4112-868d-2647ca465647 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:41:45.807876 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-fb2f6004-90ec-4112-868d-2647ca465647 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:41:45.815467 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-fb2f6004-90ec-4112-868d-2647ca465647 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/17617406-8552-41a3-af72-233263b37ee1" status: 200 len: 1267 microversion: 2.1 time: 0.152862 Jun 14 18:41:45.816018 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 566/1156] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:41:45 2022] GET /compute/v2.1/servers/17617406-8552-41a3-af72-233263b37ee1 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:41:46.307186 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-2e06a958-6597-43b1-974f-f2da2e6766b0 req-3545822f-2473-424f-8242-34382b96e3e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17617406-8552-41a3-af72-233263b37ee1", "name": "network-vif-plugged", "status": "completed", "tag": "859bffd8-598b-4d49-80fd-4bca38b933fb"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:41:46.316107 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-2e06a958-6597-43b1-974f-f2da2e6766b0 req-3545822f-2473-424f-8242-34382b96e3e9 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:41:46.317300 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-2e06a958-6597-43b1-974f-f2da2e6766b0 req-3545822f-2473-424f-8242-34382b96e3e9 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:41:46.328441 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-2e06a958-6597-43b1-974f-f2da2e6766b0 req-3545822f-2473-424f-8242-34382b96e3e9 service nova] Creating event network-vif-plugged:859bffd8-598b-4d49-80fd-4bca38b933fb for instance 17617406-8552-41a3-af72-233263b37ee1 on hv-cinder-84456 Jun 14 18:41:46.333575 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-2e06a958-6597-43b1-974f-f2da2e6766b0 req-3545822f-2473-424f-8242-34382b96e3e9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030215 Jun 14 18:41:46.334158 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 591/1157] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:41:46.833557 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-58c4906a-d836-4a50-bc0e-89d97b8fd24b tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:41:46.834105 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-58c4906a-d836-4a50-bc0e-89d97b8fd24b tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 17617406-8552-41a3-af72-233263b37ee1] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:41:46.840477 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-58c4906a-d836-4a50-bc0e-89d97b8fd24b tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:41:46.840918 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-58c4906a-d836-4a50-bc0e-89d97b8fd24b tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:41:46.841703 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-58c4906a-d836-4a50-bc0e-89d97b8fd24b tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:41:46.842139 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-58c4906a-d836-4a50-bc0e-89d97b8fd24b tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:41:46.978263 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-58c4906a-d836-4a50-bc0e-89d97b8fd24b tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:41:46.985708 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-58c4906a-d836-4a50-bc0e-89d97b8fd24b tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/17617406-8552-41a3-af72-233263b37ee1" status: 200 len: 1267 microversion: 2.1 time: 0.156464 Jun 14 18:41:46.986262 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 567/1158] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:41:46 2022] GET /compute/v2.1/servers/17617406-8552-41a3-af72-233263b37ee1 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:41:48.004878 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-02ab911f-188f-4fcb-ad05-1b3220ac54c3 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:41:48.005494 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-02ab911f-188f-4fcb-ad05-1b3220ac54c3 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 17617406-8552-41a3-af72-233263b37ee1] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:41:48.011774 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-02ab911f-188f-4fcb-ad05-1b3220ac54c3 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:41:48.012311 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-02ab911f-188f-4fcb-ad05-1b3220ac54c3 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:41:48.013073 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-02ab911f-188f-4fcb-ad05-1b3220ac54c3 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:41:48.013528 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-02ab911f-188f-4fcb-ad05-1b3220ac54c3 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:41:48.152428 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-02ab911f-188f-4fcb-ad05-1b3220ac54c3 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:41:48.160534 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-02ab911f-188f-4fcb-ad05-1b3220ac54c3 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/17617406-8552-41a3-af72-233263b37ee1" status: 200 len: 1454 microversion: 2.1 time: 0.161273 Jun 14 18:41:48.161297 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 592/1159] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:41:47 2022] GET /compute/v2.1/servers/17617406-8552-41a3-af72-233263b37ee1 => generated 1454 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:41:48.178342 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-fa29ddd8-9c48-4a4a-9315-3cb1f0f10cc7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:41:48.178975 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-fa29ddd8-9c48-4a4a-9315-3cb1f0f10cc7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 17617406-8552-41a3-af72-233263b37ee1] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:41:48.185531 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-fa29ddd8-9c48-4a4a-9315-3cb1f0f10cc7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:41:48.185985 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-fa29ddd8-9c48-4a4a-9315-3cb1f0f10cc7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:41:48.186757 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-fa29ddd8-9c48-4a4a-9315-3cb1f0f10cc7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:41:48.187199 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-fa29ddd8-9c48-4a4a-9315-3cb1f0f10cc7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:41:48.319117 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-fa29ddd8-9c48-4a4a-9315-3cb1f0f10cc7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:41:48.326720 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-fa29ddd8-9c48-4a4a-9315-3cb1f0f10cc7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/17617406-8552-41a3-af72-233263b37ee1" status: 200 len: 1454 microversion: 2.1 time: 0.153199 Jun 14 18:41:48.327282 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 568/1160] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:41:48 2022] GET /compute/v2.1/servers/17617406-8552-41a3-af72-233263b37ee1 => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:41:50.285303 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-2bcc5d8e-06e3-4f77-8a5e-685007be1e64 req-d81a0e8a-8890-437a-9255-d364a61d55a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17617406-8552-41a3-af72-233263b37ee1", "tag": "859bffd8-598b-4d49-80fd-4bca38b933fb"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:41:50.293954 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-2bcc5d8e-06e3-4f77-8a5e-685007be1e64 req-d81a0e8a-8890-437a-9255-d364a61d55a6 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:41:50.294397 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-2bcc5d8e-06e3-4f77-8a5e-685007be1e64 req-d81a0e8a-8890-437a-9255-d364a61d55a6 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:41:50.305673 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-2bcc5d8e-06e3-4f77-8a5e-685007be1e64 req-d81a0e8a-8890-437a-9255-d364a61d55a6 service nova] Creating event network-changed:859bffd8-598b-4d49-80fd-4bca38b933fb for instance 17617406-8552-41a3-af72-233263b37ee1 on hv-cinder-84456 Jun 14 18:41:50.310526 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-2bcc5d8e-06e3-4f77-8a5e-685007be1e64 req-d81a0e8a-8890-437a-9255-d364a61d55a6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028865 Jun 14 18:41:50.311276 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 593/1161] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:42:18.716814 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 18:42:18.717674 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Tue Jun 14 18:42:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 14 18:42:23.724766 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 18:42:23.725354 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Tue Jun 14 18:42:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 14 18:42:32.633555 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 18:42:32.634052 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Tue Jun 14 18:42:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 14 18:43:10.258562 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 18:43:10.259172 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Tue Jun 14 18:43:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 14 18:43:22.454780 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-99b4565a-95c0-4096-abd5-b5b600cbf7a7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:43:22.455447 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_api:SELECT=22 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:43:22.455823 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-99b4565a-95c0-4096-abd5-b5b600cbf7a7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 17617406-8552-41a3-af72-233263b37ee1] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:43:22.455914 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG dbcounter [-] [118624] Writing DB stats nova_cell1:SELECT=42 {{(pid=118624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:43:22.457692 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:43:22.458341 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG dbcounter [-] [118623] Writing DB stats nova_cell1:SELECT=50 {{(pid=118623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:43:22.463388 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-99b4565a-95c0-4096-abd5-b5b600cbf7a7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:43:22.464050 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-99b4565a-95c0-4096-abd5-b5b600cbf7a7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:43:22.464825 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-99b4565a-95c0-4096-abd5-b5b600cbf7a7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:43:22.465259 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-99b4565a-95c0-4096-abd5-b5b600cbf7a7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:43:22.500765 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-99b4565a-95c0-4096-abd5-b5b600cbf7a7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 17617406-8552-41a3-af72-233263b37ee1] Going to try to terminate instance {{(pid=118623) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:43:22.562188 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-66573c4c-27b1-4029-9f9d-921e23137c8b req-c117b7a1-118f-47e9-8e0f-d788deabb503 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17617406-8552-41a3-af72-233263b37ee1", "tag": "859bffd8-598b-4d49-80fd-4bca38b933fb"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:43:22.568581 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-66573c4c-27b1-4029-9f9d-921e23137c8b req-c117b7a1-118f-47e9-8e0f-d788deabb503 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:43:22.569030 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-66573c4c-27b1-4029-9f9d-921e23137c8b req-c117b7a1-118f-47e9-8e0f-d788deabb503 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:43:22.581193 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-66573c4c-27b1-4029-9f9d-921e23137c8b req-c117b7a1-118f-47e9-8e0f-d788deabb503 service nova] Creating event network-changed:859bffd8-598b-4d49-80fd-4bca38b933fb for instance 17617406-8552-41a3-af72-233263b37ee1 on hv-cinder-84456 Jun 14 18:43:22.586528 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-66573c4c-27b1-4029-9f9d-921e23137c8b req-c117b7a1-118f-47e9-8e0f-d788deabb503 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134735 Jun 14 18:43:22.590974 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 594/1162] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:43:22.848316 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-99b4565a-95c0-4096-abd5-b5b600cbf7a7 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "DELETE /compute/v2.1/servers/17617406-8552-41a3-af72-233263b37ee1" status: 204 len: 0 microversion: 2.1 time: 0.399359 Jun 14 18:43:22.852174 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 569/1163] 10.222.0.78 () {58 vars in 1238 bytes} [Tue Jun 14 18:43:22 2022] DELETE /compute/v2.1/servers/17617406-8552-41a3-af72-233263b37ee1 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 18:43:22.858474 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-2e976cb6-75c8-47fb-a06e-679badb3c82d tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:43:22.859178 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-2e976cb6-75c8-47fb-a06e-679badb3c82d tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 17617406-8552-41a3-af72-233263b37ee1] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:43:22.866759 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2e976cb6-75c8-47fb-a06e-679badb3c82d tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:43:22.867225 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2e976cb6-75c8-47fb-a06e-679badb3c82d tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:43:22.868131 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2e976cb6-75c8-47fb-a06e-679badb3c82d tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:43:22.868567 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-2e976cb6-75c8-47fb-a06e-679badb3c82d tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:43:23.069786 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-2e976cb6-75c8-47fb-a06e-679badb3c82d tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:43:23.079243 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-2e976cb6-75c8-47fb-a06e-679badb3c82d tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/17617406-8552-41a3-af72-233263b37ee1" status: 200 len: 1579 microversion: 2.1 time: 0.225593 Jun 14 18:43:23.079850 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 595/1164] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:43:22 2022] GET /compute/v2.1/servers/17617406-8552-41a3-af72-233263b37ee1 => generated 1579 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:43:24.097971 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-7e625cdc-4f47-4e90-803e-c89664bf3caf tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:43:24.098583 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-7e625cdc-4f47-4e90-803e-c89664bf3caf tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 17617406-8552-41a3-af72-233263b37ee1] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:43:24.105001 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7e625cdc-4f47-4e90-803e-c89664bf3caf tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:43:24.105462 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7e625cdc-4f47-4e90-803e-c89664bf3caf tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:43:24.106214 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7e625cdc-4f47-4e90-803e-c89664bf3caf tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:43:24.106646 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7e625cdc-4f47-4e90-803e-c89664bf3caf tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:43:24.291903 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-7e625cdc-4f47-4e90-803e-c89664bf3caf tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:43:24.300195 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-7e625cdc-4f47-4e90-803e-c89664bf3caf tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/17617406-8552-41a3-af72-233263b37ee1" status: 200 len: 1579 microversion: 2.1 time: 0.206887 Jun 14 18:43:24.300782 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 570/1165] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:43:24 2022] GET /compute/v2.1/servers/17617406-8552-41a3-af72-233263b37ee1 => generated 1579 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:43:24.876001 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-d51c0b79-b587-4593-b5e4-aeba9529f44c req-c4e69425-01da-47a9-b603-cf542efc1319 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17617406-8552-41a3-af72-233263b37ee1", "name": "network-vif-deleted", "tag": "859bffd8-598b-4d49-80fd-4bca38b933fb"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:43:24.884359 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-d51c0b79-b587-4593-b5e4-aeba9529f44c req-c4e69425-01da-47a9-b603-cf542efc1319 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:43:24.884856 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-d51c0b79-b587-4593-b5e4-aeba9529f44c req-c4e69425-01da-47a9-b603-cf542efc1319 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:43:24.899694 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-d51c0b79-b587-4593-b5e4-aeba9529f44c req-c4e69425-01da-47a9-b603-cf542efc1319 service nova] Creating event network-vif-deleted:859bffd8-598b-4d49-80fd-4bca38b933fb for instance 17617406-8552-41a3-af72-233263b37ee1 on hv-cinder-84456 Jun 14 18:43:24.905847 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-d51c0b79-b587-4593-b5e4-aeba9529f44c req-c4e69425-01da-47a9-b603-cf542efc1319 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088070 Jun 14 18:43:24.906449 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 596/1166] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:43:25.316567 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-859d0a04-ffaa-4f98-95db-dad3f31ff5ee tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:43:25.317226 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-859d0a04-ffaa-4f98-95db-dad3f31ff5ee tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 17617406-8552-41a3-af72-233263b37ee1] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:43:25.324212 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-859d0a04-ffaa-4f98-95db-dad3f31ff5ee tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:43:25.324659 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-859d0a04-ffaa-4f98-95db-dad3f31ff5ee tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:43:25.325438 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-859d0a04-ffaa-4f98-95db-dad3f31ff5ee tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:43:25.325962 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-859d0a04-ffaa-4f98-95db-dad3f31ff5ee tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:43:25.389751 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-859d0a04-ffaa-4f98-95db-dad3f31ff5ee tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:43:25.397838 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-859d0a04-ffaa-4f98-95db-dad3f31ff5ee tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/17617406-8552-41a3-af72-233263b37ee1" status: 200 len: 1226 microversion: 2.1 time: 0.085314 Jun 14 18:43:25.398545 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 571/1167] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:43:25 2022] GET /compute/v2.1/servers/17617406-8552-41a3-af72-233263b37ee1 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:43:26.422303 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-b7526334-2fbe-45b0-bf9d-4b84ebf4735c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:43:26.423528 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-b7526334-2fbe-45b0-bf9d-4b84ebf4735c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 17617406-8552-41a3-af72-233263b37ee1] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:43:26.434376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b7526334-2fbe-45b0-bf9d-4b84ebf4735c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:43:26.435158 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b7526334-2fbe-45b0-bf9d-4b84ebf4735c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:43:26.436508 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b7526334-2fbe-45b0-bf9d-4b84ebf4735c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:43:26.437320 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-b7526334-2fbe-45b0-bf9d-4b84ebf4735c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:43:26.465012 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.wsgi [None req-b7526334-2fbe-45b0-bf9d-4b84ebf4735c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] HTTP exception thrown: Instance 17617406-8552-41a3-af72-233263b37ee1 could not be found. Jun 14 18:43:26.468984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-b7526334-2fbe-45b0-bf9d-4b84ebf4735c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Request method failure captured: Jun 14 18:43:26.468984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: request: GET /compute/v2.1/servers/17617406-8552-41a3-af72-233263b37ee1 HTTP/1.1 Jun 14 18:43:26.468984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept: application/json Jun 14 18:43:26.468984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept-Encoding: identity Jun 14 18:43:26.468984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Connection: close Jun 14 18:43:26.468984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Length: 0 Jun 14 18:43:26.468984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Type: application/json Jun 14 18:43:26.468984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Host: 10.222.0.78 Jun 14 18:43:26.468984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Openstack-System-Scope: None Jun 14 18:43:26.468984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: User-Agent: python-urllib3/1.26.9 Jun 14 18:43:26.468984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Auth-Token: gAAAAABiqNUXCG8vX8gDa6VOoR71txC2LJ0hlSEz1x40e7ar4jonEJshCGsn_lT5y9wFUTcgun2gfPL29rzC03Om-U3US-cP2R6hC4S830kvAxZbAW3KmUR6xeGd4b9rGuiP1N-YanADr1YP6LwpE8afmLRACwitMVQcjBivdlctRqh-nkdMgzQ Jun 14 18:43:26.468984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Id: None Jun 14 18:43:26.468984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Name: None Jun 14 18:43:26.468984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Identity-Status: Confirmed Jun 14 18:43:26.468984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Is-Admin-Project: True Jun 14 18:43:26.468984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Id: default Jun 14 18:43:26.468984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Name: Default Jun 14 18:43:26.468984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Id: 4c8c7a8868b741feb66d6a3b8c761d9e Jun 14 18:43:26.468984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Name: tempest-TestVolumeBootPattern-329983849 Jun 14 18:43:26.468984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Role: reader,member Jun 14 18:43:26.468984 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Roles: reader,member Jun 14 18:43:26.471000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4c8c7a8868b741feb66d6a3b8c761d9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4c8c7a8868b741feb66d6a3b8c761d9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4c8c7a8868b741feb66d6a3b8c761d9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4c8c7a8868b741feb66d6a3b8c761d9e"}]}] Jun 14 18:43:26.471000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant: tempest-TestVolumeBootPattern-329983849 Jun 14 18:43:26.471000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Id: 4c8c7a8868b741feb66d6a3b8c761d9e Jun 14 18:43:26.471000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Name: tempest-TestVolumeBootPattern-329983849 Jun 14 18:43:26.471000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User: tempest-TestVolumeBootPattern-329983849-project Jun 14 18:43:26.471000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Id: default Jun 14 18:43:26.471000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Name: Default Jun 14 18:43:26.471000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Id: f9df6279bdd140448c4f7717942f2beb Jun 14 18:43:26.471000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Name: tempest-TestVolumeBootPattern-329983849-project Jun 14 18:43:26.471000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: method: > Jun 14 18:43:26.471000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: exception: Instance 17617406-8552-41a3-af72-233263b37ee1 could not be found. Jun 14 18:43:26.471000 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: action_args: {'id': '17617406-8552-41a3-af72-233263b37ee1'} Jun 14 18:43:26.471862 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:43:26.471862 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:43:26.471862 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:43:26.471862 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:43:26.471862 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:43:26.471862 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:43:26.471862 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:43:26.471862 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:43:26.471862 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:43:26.471862 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:43:26.471862 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17617406-8552-41a3-af72-233263b37ee1 could not be found. Jun 14 18:43:26.471862 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:43:26.471862 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:43:26.471862 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:43:26.471862 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:43:26.471862 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:43:26.471862 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:43:26.471862 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:43:26.471862 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:43:26.471862 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:43:26.473332 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:43:26.473332 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:43:26.473332 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:43:26.473332 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:43:26.473332 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:43:26.473332 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:43:26.473332 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:43:26.473332 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17617406-8552-41a3-af72-233263b37ee1 could not be found. Jun 14 18:43:26.473332 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:43:26.473332 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:43:26.473332 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:43:26.473332 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:43:26.473332 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:43:26.473332 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:43:26.473332 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:43:26.473332 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:43:26.473332 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17617406-8552-41a3-af72-233263b37ee1 could not be found. Jun 14 18:43:26.473332 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:43:26.475018 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-b7526334-2fbe-45b0-bf9d-4b84ebf4735c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Returning 404 to user: Instance 17617406-8552-41a3-af72-233263b37ee1 could not be found. {{(pid=118624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:43:26.475018 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-b7526334-2fbe-45b0-bf9d-4b84ebf4735c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/17617406-8552-41a3-af72-233263b37ee1" status: 404 len: 111 microversion: 2.1 time: 0.058012 Jun 14 18:43:26.475018 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 597/1168] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:43:26 2022] GET /compute/v2.1/servers/17617406-8552-41a3-af72-233263b37ee1 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:43:30.110546 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-192f5a53-0c0d-4d44-8c05-1472cfb8cba8 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:43:30.111100 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-192f5a53-0c0d-4d44-8c05-1472cfb8cba8 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 7579bfbd-2387-4568-8c0b-111b987450ca] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:43:30.113548 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-2e04ab3b-551d-4a29-8cf4-9b03ca3c48f5 req-77f8dce1-6fa4-4866-bacc-c4882e17f599 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7579bfbd-2387-4568-8c0b-111b987450ca", "tag": "e381693f-6e0b-4d1d-87a0-51d476d74063"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:43:30.118021 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-192f5a53-0c0d-4d44-8c05-1472cfb8cba8 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:43:30.118818 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-192f5a53-0c0d-4d44-8c05-1472cfb8cba8 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:43:30.119894 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-192f5a53-0c0d-4d44-8c05-1472cfb8cba8 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:43:30.120576 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-192f5a53-0c0d-4d44-8c05-1472cfb8cba8 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:43:30.129376 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-2e04ab3b-551d-4a29-8cf4-9b03ca3c48f5 req-77f8dce1-6fa4-4866-bacc-c4882e17f599 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:43:30.129940 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-2e04ab3b-551d-4a29-8cf4-9b03ca3c48f5 req-77f8dce1-6fa4-4866-bacc-c4882e17f599 service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:43:30.147118 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-2e04ab3b-551d-4a29-8cf4-9b03ca3c48f5 req-77f8dce1-6fa4-4866-bacc-c4882e17f599 service nova] Creating event network-changed:e381693f-6e0b-4d1d-87a0-51d476d74063 for instance 7579bfbd-2387-4568-8c0b-111b987450ca on hv-cinder-84456 Jun 14 18:43:30.151805 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-192f5a53-0c0d-4d44-8c05-1472cfb8cba8 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 7579bfbd-2387-4568-8c0b-111b987450ca] Going to try to terminate instance {{(pid=118623) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:43:30.152453 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-2e04ab3b-551d-4a29-8cf4-9b03ca3c48f5 req-77f8dce1-6fa4-4866-bacc-c4882e17f599 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042918 Jun 14 18:43:30.153388 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 598/1169] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:43:30.474191 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-192f5a53-0c0d-4d44-8c05-1472cfb8cba8 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca" status: 204 len: 0 microversion: 2.1 time: 0.367213 Jun 14 18:43:30.475622 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 572/1170] 10.222.0.78 () {58 vars in 1238 bytes} [Tue Jun 14 18:43:30 2022] DELETE /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 18:43:30.486928 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-7fad661b-f18f-4557-a4e1-ba5d772f146c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:43:30.487638 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-7fad661b-f18f-4557-a4e1-ba5d772f146c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 7579bfbd-2387-4568-8c0b-111b987450ca] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:43:30.495246 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7fad661b-f18f-4557-a4e1-ba5d772f146c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:43:30.496284 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7fad661b-f18f-4557-a4e1-ba5d772f146c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:43:30.497190 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7fad661b-f18f-4557-a4e1-ba5d772f146c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:43:30.497888 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-7fad661b-f18f-4557-a4e1-ba5d772f146c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:43:30.685181 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.policy [None req-7fad661b-f18f-4557-a4e1-ba5d772f146c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118624) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:43:30.698577 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-7fad661b-f18f-4557-a4e1-ba5d772f146c tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca" status: 200 len: 1578 microversion: 2.1 time: 0.217190 Jun 14 18:43:30.699686 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 599/1171] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:43:30 2022] GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca => generated 1578 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:43:31.719481 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-7a59450f-d09a-44ba-952b-72816e95a066 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:43:31.720182 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-7a59450f-d09a-44ba-952b-72816e95a066 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 7579bfbd-2387-4568-8c0b-111b987450ca] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:43:31.727027 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7a59450f-d09a-44ba-952b-72816e95a066 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:43:31.727670 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7a59450f-d09a-44ba-952b-72816e95a066 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:43:31.728211 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7a59450f-d09a-44ba-952b-72816e95a066 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:43:31.728637 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-7a59450f-d09a-44ba-952b-72816e95a066 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:43:32.003011 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-7a59450f-d09a-44ba-952b-72816e95a066 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:43:32.003011 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-7a59450f-d09a-44ba-952b-72816e95a066 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca" status: 200 len: 1578 microversion: 2.1 time: 0.237892 Jun 14 18:43:32.003011 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 573/1172] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:43:31 2022] GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca => generated 1578 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:43:32.565007 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [req-33e132dd-21ab-4fa6-aeef-a083fbf11708 req-bcf778f4-21e9-4f88-9742-a69c8265c91e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7579bfbd-2387-4568-8c0b-111b987450ca", "name": "network-vif-deleted", "tag": "e381693f-6e0b-4d1d-87a0-51d476d74063"}]} {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:43:32.576216 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-33e132dd-21ab-4fa6-aeef-a083fbf11708 req-bcf778f4-21e9-4f88-9742-a69c8265c91e service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:43:32.580513 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [req-33e132dd-21ab-4fa6-aeef-a083fbf11708 req-bcf778f4-21e9-4f88-9742-a69c8265c91e service nova] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:43:32.591335 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.compute.server_external_events [req-33e132dd-21ab-4fa6-aeef-a083fbf11708 req-bcf778f4-21e9-4f88-9742-a69c8265c91e service nova] Creating event network-vif-deleted:e381693f-6e0b-4d1d-87a0-51d476d74063 for instance 7579bfbd-2387-4568-8c0b-111b987450ca on hv-cinder-84456 Jun 14 18:43:32.597261 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [req-33e132dd-21ab-4fa6-aeef-a083fbf11708 req-bcf778f4-21e9-4f88-9742-a69c8265c91e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035962 Jun 14 18:43:32.597885 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 600/1173] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Jun 14 18:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:43:32.970900 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-562c137c-7f3d-4090-ae58-08c1b55afd6a tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:43:32.971804 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-562c137c-7f3d-4090-ae58-08c1b55afd6a tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 7579bfbd-2387-4568-8c0b-111b987450ca] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:43:32.979027 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-562c137c-7f3d-4090-ae58-08c1b55afd6a tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:43:32.979857 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-562c137c-7f3d-4090-ae58-08c1b55afd6a tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:43:32.980856 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-562c137c-7f3d-4090-ae58-08c1b55afd6a tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:43:32.981292 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-562c137c-7f3d-4090-ae58-08c1b55afd6a tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:43:33.054255 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.policy [None req-562c137c-7f3d-4090-ae58-08c1b55afd6a tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9df6279bdd140448c4f7717942f2beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8c7a8868b741feb66d6a3b8c761d9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118623) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:43:33.063505 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-562c137c-7f3d-4090-ae58-08c1b55afd6a tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca" status: 200 len: 1225 microversion: 2.1 time: 0.097576 Jun 14 18:43:33.064009 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 574/1174] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:43:32 2022] GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:43:34.081239 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-1a6822a7-07af-4e53-bb34-e4b038746919 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:43:34.082116 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-1a6822a7-07af-4e53-bb34-e4b038746919 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: 7579bfbd-2387-4568-8c0b-111b987450ca] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:43:34.089284 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1a6822a7-07af-4e53-bb34-e4b038746919 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:43:34.089763 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1a6822a7-07af-4e53-bb34-e4b038746919 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:43:34.090553 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1a6822a7-07af-4e53-bb34-e4b038746919 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:43:34.090986 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-1a6822a7-07af-4e53-bb34-e4b038746919 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:43:34.105420 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.wsgi [None req-1a6822a7-07af-4e53-bb34-e4b038746919 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] HTTP exception thrown: Instance 7579bfbd-2387-4568-8c0b-111b987450ca could not be found. Jun 14 18:43:34.107234 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-1a6822a7-07af-4e53-bb34-e4b038746919 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Request method failure captured: Jun 14 18:43:34.107234 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: request: GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca HTTP/1.1 Jun 14 18:43:34.107234 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept: application/json Jun 14 18:43:34.107234 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept-Encoding: identity Jun 14 18:43:34.107234 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Connection: close Jun 14 18:43:34.107234 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Length: 0 Jun 14 18:43:34.107234 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Type: application/json Jun 14 18:43:34.107234 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Host: 10.222.0.78 Jun 14 18:43:34.107234 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Openstack-System-Scope: None Jun 14 18:43:34.107234 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: User-Agent: python-urllib3/1.26.9 Jun 14 18:43:34.107234 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Auth-Token: gAAAAABiqNUXCG8vX8gDa6VOoR71txC2LJ0hlSEz1x40e7ar4jonEJshCGsn_lT5y9wFUTcgun2gfPL29rzC03Om-U3US-cP2R6hC4S830kvAxZbAW3KmUR6xeGd4b9rGuiP1N-YanADr1YP6LwpE8afmLRACwitMVQcjBivdlctRqh-nkdMgzQ Jun 14 18:43:34.107234 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Id: None Jun 14 18:43:34.107234 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Name: None Jun 14 18:43:34.107234 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Identity-Status: Confirmed Jun 14 18:43:34.107234 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Is-Admin-Project: True Jun 14 18:43:34.107234 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Id: default Jun 14 18:43:34.107234 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Name: Default Jun 14 18:43:34.107234 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Id: 4c8c7a8868b741feb66d6a3b8c761d9e Jun 14 18:43:34.107234 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Name: tempest-TestVolumeBootPattern-329983849 Jun 14 18:43:34.107234 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Role: reader,member Jun 14 18:43:34.107234 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Roles: reader,member Jun 14 18:43:34.108680 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4c8c7a8868b741feb66d6a3b8c761d9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4c8c7a8868b741feb66d6a3b8c761d9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4c8c7a8868b741feb66d6a3b8c761d9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4c8c7a8868b741feb66d6a3b8c761d9e"}]}] Jun 14 18:43:34.108680 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant: tempest-TestVolumeBootPattern-329983849 Jun 14 18:43:34.108680 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Id: 4c8c7a8868b741feb66d6a3b8c761d9e Jun 14 18:43:34.108680 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Name: tempest-TestVolumeBootPattern-329983849 Jun 14 18:43:34.108680 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User: tempest-TestVolumeBootPattern-329983849-project Jun 14 18:43:34.108680 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Id: default Jun 14 18:43:34.108680 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Name: Default Jun 14 18:43:34.108680 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Id: f9df6279bdd140448c4f7717942f2beb Jun 14 18:43:34.108680 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Name: tempest-TestVolumeBootPattern-329983849-project Jun 14 18:43:34.108680 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: method: > Jun 14 18:43:34.108680 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: exception: Instance 7579bfbd-2387-4568-8c0b-111b987450ca could not be found. Jun 14 18:43:34.108680 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: action_args: {'id': '7579bfbd-2387-4568-8c0b-111b987450ca'} Jun 14 18:43:34.110260 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:43:34.110260 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:43:34.110260 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:43:34.110260 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:43:34.110260 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:43:34.110260 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:43:34.110260 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:43:34.110260 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:43:34.110260 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:43:34.110260 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:43:34.110260 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7579bfbd-2387-4568-8c0b-111b987450ca could not be found. Jun 14 18:43:34.110260 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:43:34.110260 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:43:34.110260 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:43:34.110260 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:43:34.110260 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:43:34.110260 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:43:34.110260 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:43:34.110260 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:43:34.110260 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:43:34.112031 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:43:34.112031 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:43:34.112031 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:43:34.112031 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:43:34.112031 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:43:34.112031 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:43:34.112031 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:43:34.112031 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7579bfbd-2387-4568-8c0b-111b987450ca could not be found. Jun 14 18:43:34.112031 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:43:34.112031 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:43:34.112031 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:43:34.112031 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:43:34.112031 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:43:34.112031 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:43:34.112031 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:43:34.112031 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:43:34.112031 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7579bfbd-2387-4568-8c0b-111b987450ca could not be found. Jun 14 18:43:34.112031 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:43:34.113804 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-1a6822a7-07af-4e53-bb34-e4b038746919 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Returning 404 to user: Instance 7579bfbd-2387-4568-8c0b-111b987450ca could not be found. {{(pid=118624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:43:34.113804 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-1a6822a7-07af-4e53-bb34-e4b038746919 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca" status: 404 len: 111 microversion: 2.1 time: 0.031968 Jun 14 18:43:34.113804 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 601/1175] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:43:34 2022] GET /compute/v2.1/servers/7579bfbd-2387-4568-8c0b-111b987450ca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:43:34.717865 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-a3eb4e54-a1ae-4305-9883-929bd32e1991 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:43:34.718522 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.compute.api [None req-a3eb4e54-a1ae-4305-9883-929bd32e1991 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: c004d7e4-71d3-418b-95f2-736cef250bdc] Fetching instance by UUID {{(pid=118623) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:43:34.725652 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a3eb4e54-a1ae-4305-9883-929bd32e1991 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:43:34.726103 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a3eb4e54-a1ae-4305-9883-929bd32e1991 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:43:34.726891 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a3eb4e54-a1ae-4305-9883-929bd32e1991 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:43:34.727325 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG oslo_concurrency.lockutils [None req-a3eb4e54-a1ae-4305-9883-929bd32e1991 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:43:34.745992 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.wsgi [None req-a3eb4e54-a1ae-4305-9883-929bd32e1991 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] HTTP exception thrown: Instance c004d7e4-71d3-418b-95f2-736cef250bdc could not be found. Jun 14 18:43:34.747759 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-a3eb4e54-a1ae-4305-9883-929bd32e1991 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Request method failure captured: Jun 14 18:43:34.747759 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: request: DELETE /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc HTTP/1.1 Jun 14 18:43:34.747759 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept: application/json Jun 14 18:43:34.747759 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Accept-Encoding: identity Jun 14 18:43:34.747759 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Connection: close Jun 14 18:43:34.747759 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Length: 0 Jun 14 18:43:34.747759 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Content-Type: application/json Jun 14 18:43:34.747759 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Host: 10.222.0.78 Jun 14 18:43:34.747759 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Openstack-System-Scope: None Jun 14 18:43:34.747759 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: User-Agent: python-urllib3/1.26.9 Jun 14 18:43:34.747759 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Auth-Token: gAAAAABiqNUXCG8vX8gDa6VOoR71txC2LJ0hlSEz1x40e7ar4jonEJshCGsn_lT5y9wFUTcgun2gfPL29rzC03Om-U3US-cP2R6hC4S830kvAxZbAW3KmUR6xeGd4b9rGuiP1N-YanADr1YP6LwpE8afmLRACwitMVQcjBivdlctRqh-nkdMgzQ Jun 14 18:43:34.747759 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Id: None Jun 14 18:43:34.747759 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Domain-Name: None Jun 14 18:43:34.747759 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Identity-Status: Confirmed Jun 14 18:43:34.747759 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Is-Admin-Project: True Jun 14 18:43:34.747759 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Id: default Jun 14 18:43:34.747759 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Domain-Name: Default Jun 14 18:43:34.747759 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Id: 4c8c7a8868b741feb66d6a3b8c761d9e Jun 14 18:43:34.747759 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Project-Name: tempest-TestVolumeBootPattern-329983849 Jun 14 18:43:34.747759 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Role: reader,member Jun 14 18:43:34.747759 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Roles: reader,member Jun 14 18:43:34.749959 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4c8c7a8868b741feb66d6a3b8c761d9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4c8c7a8868b741feb66d6a3b8c761d9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4c8c7a8868b741feb66d6a3b8c761d9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4c8c7a8868b741feb66d6a3b8c761d9e"}]}] Jun 14 18:43:34.749959 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant: tempest-TestVolumeBootPattern-329983849 Jun 14 18:43:34.749959 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Id: 4c8c7a8868b741feb66d6a3b8c761d9e Jun 14 18:43:34.749959 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-Tenant-Name: tempest-TestVolumeBootPattern-329983849 Jun 14 18:43:34.749959 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User: tempest-TestVolumeBootPattern-329983849-project Jun 14 18:43:34.749959 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Id: default Jun 14 18:43:34.749959 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Domain-Name: Default Jun 14 18:43:34.749959 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Id: f9df6279bdd140448c4f7717942f2beb Jun 14 18:43:34.749959 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: X-User-Name: tempest-TestVolumeBootPattern-329983849-project Jun 14 18:43:34.749959 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: method: > Jun 14 18:43:34.749959 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: exception: Instance c004d7e4-71d3-418b-95f2-736cef250bdc could not be found. Jun 14 18:43:34.749959 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: action_args: {'id': 'c004d7e4-71d3-418b-95f2-736cef250bdc'} Jun 14 18:43:34.751040 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:43:34.751040 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:43:34.751040 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:43:34.751040 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:43:34.751040 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:43:34.751040 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:43:34.751040 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:43:34.751040 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:43:34.751040 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:43:34.751040 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:43:34.751040 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c004d7e4-71d3-418b-95f2-736cef250bdc could not be found. Jun 14 18:43:34.751040 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:43:34.751040 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:43:34.751040 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:43:34.751040 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:43:34.751040 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:43:34.751040 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:43:34.751040 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:43:34.751040 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:43:34.751040 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:43:34.752409 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:43:34.752409 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 14 18:43:34.752409 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 14 18:43:34.752409 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 14 18:43:34.752409 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 14 18:43:34.752409 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:43:34.752409 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:43:34.752409 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:43:34.752409 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:43:34.752409 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c004d7e4-71d3-418b-95f2-736cef250bdc could not be found. Jun 14 18:43:34.752409 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:43:34.752409 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:43:34.752409 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:43:34.752409 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:43:34.752409 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:43:34.752409 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:43:34.752409 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:43:34.752409 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:43:34.752409 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c004d7e4-71d3-418b-95f2-736cef250bdc could not be found. Jun 14 18:43:34.752409 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: ERROR nova.api.openstack.wsgi Jun 14 18:43:34.753778 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-a3eb4e54-a1ae-4305-9883-929bd32e1991 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Returning 404 to user: Instance c004d7e4-71d3-418b-95f2-736cef250bdc could not be found. {{(pid=118623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:43:34.753778 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-a3eb4e54-a1ae-4305-9883-929bd32e1991 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc" status: 404 len: 111 microversion: 2.1 time: 0.036092 Jun 14 18:43:34.753778 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 575/1176] 10.222.0.78 () {58 vars in 1238 bytes} [Tue Jun 14 18:43:34 2022] DELETE /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:43:34.759146 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-a17bf81f-84f1-4a95-b196-f6e437f2a337 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '>' {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:43:34.759761 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.compute.api [None req-a17bf81f-84f1-4a95-b196-f6e437f2a337 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] [instance: c004d7e4-71d3-418b-95f2-736cef250bdc] Fetching instance by UUID {{(pid=118624) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:43:34.766357 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a17bf81f-84f1-4a95-b196-f6e437f2a337 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:43:34.766924 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a17bf81f-84f1-4a95-b196-f6e437f2a337 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:43:34.767947 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a17bf81f-84f1-4a95-b196-f6e437f2a337 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:43:34.768383 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG oslo_concurrency.lockutils [None req-a17bf81f-84f1-4a95-b196-f6e437f2a337 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Lock "fc5dd7f6-292c-4a57-9b07-38a1b91b5959" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:43:34.782794 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.wsgi [None req-a17bf81f-84f1-4a95-b196-f6e437f2a337 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] HTTP exception thrown: Instance c004d7e4-71d3-418b-95f2-736cef250bdc could not be found. Jun 14 18:43:34.784344 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-a17bf81f-84f1-4a95-b196-f6e437f2a337 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Request method failure captured: Jun 14 18:43:34.784344 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: request: GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc HTTP/1.1 Jun 14 18:43:34.784344 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept: application/json Jun 14 18:43:34.784344 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Accept-Encoding: identity Jun 14 18:43:34.784344 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Connection: close Jun 14 18:43:34.784344 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Length: 0 Jun 14 18:43:34.784344 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Content-Type: application/json Jun 14 18:43:34.784344 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Host: 10.222.0.78 Jun 14 18:43:34.784344 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Openstack-System-Scope: None Jun 14 18:43:34.784344 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: User-Agent: python-urllib3/1.26.9 Jun 14 18:43:34.784344 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Auth-Token: gAAAAABiqNUXCG8vX8gDa6VOoR71txC2LJ0hlSEz1x40e7ar4jonEJshCGsn_lT5y9wFUTcgun2gfPL29rzC03Om-U3US-cP2R6hC4S830kvAxZbAW3KmUR6xeGd4b9rGuiP1N-YanADr1YP6LwpE8afmLRACwitMVQcjBivdlctRqh-nkdMgzQ Jun 14 18:43:34.784344 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Id: None Jun 14 18:43:34.784344 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Domain-Name: None Jun 14 18:43:34.784344 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Identity-Status: Confirmed Jun 14 18:43:34.784344 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Is-Admin-Project: True Jun 14 18:43:34.784344 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Id: default Jun 14 18:43:34.784344 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Domain-Name: Default Jun 14 18:43:34.784344 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Id: 4c8c7a8868b741feb66d6a3b8c761d9e Jun 14 18:43:34.784344 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Project-Name: tempest-TestVolumeBootPattern-329983849 Jun 14 18:43:34.784344 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Role: reader,member Jun 14 18:43:34.784344 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Roles: reader,member Jun 14 18:43:34.786070 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4c8c7a8868b741feb66d6a3b8c761d9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4c8c7a8868b741feb66d6a3b8c761d9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4c8c7a8868b741feb66d6a3b8c761d9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4c8c7a8868b741feb66d6a3b8c761d9e"}]}] Jun 14 18:43:34.786070 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant: tempest-TestVolumeBootPattern-329983849 Jun 14 18:43:34.786070 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Id: 4c8c7a8868b741feb66d6a3b8c761d9e Jun 14 18:43:34.786070 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-Tenant-Name: tempest-TestVolumeBootPattern-329983849 Jun 14 18:43:34.786070 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User: tempest-TestVolumeBootPattern-329983849-project Jun 14 18:43:34.786070 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Id: default Jun 14 18:43:34.786070 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Domain-Name: Default Jun 14 18:43:34.786070 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Id: f9df6279bdd140448c4f7717942f2beb Jun 14 18:43:34.786070 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: X-User-Name: tempest-TestVolumeBootPattern-329983849-project Jun 14 18:43:34.786070 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: method: > Jun 14 18:43:34.786070 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: exception: Instance c004d7e4-71d3-418b-95f2-736cef250bdc could not be found. Jun 14 18:43:34.786070 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: action_args: {'id': 'c004d7e4-71d3-418b-95f2-736cef250bdc'} Jun 14 18:43:34.787067 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: {{(pid=118624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:43:34.787067 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:43:34.787067 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:43:34.787067 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:43:34.787067 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:43:34.787067 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:43:34.787067 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:43:34.787067 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:43:34.787067 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:43:34.787067 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:43:34.787067 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c004d7e4-71d3-418b-95f2-736cef250bdc could not be found. Jun 14 18:43:34.787067 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:43:34.787067 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:43:34.787067 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:43:34.787067 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:43:34.787067 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:43:34.787067 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:43:34.787067 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:43:34.787067 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:43:34.787067 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:43:34.788579 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:43:34.788579 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:43:34.788579 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:43:34.788579 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:43:34.788579 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:43:34.788579 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:43:34.788579 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:43:34.788579 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c004d7e4-71d3-418b-95f2-736cef250bdc could not be found. Jun 14 18:43:34.788579 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:43:34.788579 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:43:34.788579 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:43:34.788579 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:43:34.788579 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:43:34.788579 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:43:34.788579 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:43:34.788579 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:43:34.788579 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c004d7e4-71d3-418b-95f2-736cef250bdc could not be found. Jun 14 18:43:34.788579 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: ERROR nova.api.openstack.wsgi Jun 14 18:43:34.789931 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: DEBUG nova.api.openstack.wsgi [None req-a17bf81f-84f1-4a95-b196-f6e437f2a337 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Returning 404 to user: Instance c004d7e4-71d3-418b-95f2-736cef250bdc could not be found. {{(pid=118624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:43:34.789931 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO nova.api.openstack.requestlog [None req-a17bf81f-84f1-4a95-b196-f6e437f2a337 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc" status: 404 len: 111 microversion: 2.1 time: 0.030615 Jun 14 18:43:34.789931 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: [pid: 118624|app: 0|req: 602/1177] 10.222.0.78 () {58 vars in 1235 bytes} [Tue Jun 14 18:43:34 2022] GET /compute/v2.1/servers/c004d7e4-71d3-418b-95f2-736cef250bdc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:43:36.719716 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: DEBUG nova.api.openstack.wsgi [None req-feecd7b9-fdb3-4c8d-be06-e803942bcd20 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] Calling method '.version_select at 0x7efe715055e0>' {{(pid=118623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:43:36.801988 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO nova.api.openstack.requestlog [None req-feecd7b9-fdb3-4c8d-be06-e803942bcd20 tempest-TestVolumeBootPattern-329983849 tempest-TestVolumeBootPattern-329983849-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1923373548" status: 202 len: 0 microversion: 2.1 time: 0.086290 Jun 14 18:43:36.802560 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: [pid: 118623|app: 0|req: 576/1178] 10.222.0.78 () {58 vars in 1262 bytes} [Tue Jun 14 18:43:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1923373548 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:45:38.725582 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 18:45:38.726947 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Tue Jun 14 18:45:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 14 18:45:52.642071 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 18:45:52.642729 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Tue Jun 14 18:45:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 14 18:46:01.518475 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 18:46:01.519049 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Tue Jun 14 18:46:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 14 18:46:30.268712 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 18:46:30.269406 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Tue Jun 14 18:46:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 14 18:47:03.289820 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 18:47:03.292575 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Tue Jun 14 18:47:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 14 18:48:58.735385 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 18:48:58.736055 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Tue Jun 14 18:48:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 14 18:49:03.736672 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 18:49:03.737229 dv-cinder-844563-2-iscsi devstack@n-api.service[118623]: Tue Jun 14 18:49:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 14 18:49:12.650622 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 18:49:12.651220 dv-cinder-844563-2-iscsi devstack@n-api.service[118624]: Tue Jun 14 18:49:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!